Using the freshest ELPA version, run the ledger check function from the menu. You should be able to hit and have it go to that place in the buffer. If will go nearly to the beginning of the buffer
This is because the Ledger Check report uses EMACS markers while the visit source code expect line numbers, which is what the various ledger reports will put out.
I have a fix ready, but i have just move to a new machine and haven't gotten my GITHUB authentication working yet.