On this page
A new mortgage virtual assistant can pass an interview and still misname a document on the first live file. The gap is usually not effort or intelligence. It is the difference between understanding a workflow in conversation and applying it under a deadline with a real borrower waiting. A short knowledge check closes that gap before the new person touches production work.
Test the rules the file depends on
Start with the rules that cause immediate rework when they are missed. Document naming, receipt timestamps, condition status, escalation triggers, and access boundaries belong on the list. These are the decisions a new specialist makes dozens of times a day, often without asking. A check that ignores them tests the wrong thing.
Leave out questions about mortgage history or product trivia unless the role actually uses that knowledge. A specialist who can recite loan program limits but cannot tell a stale pay stub from a current one will still create rework. Test the task, not the vocabulary. The best questions mirror a real file that the team has already closed.
Keep the first version to about fifteen items. A long exam discourages completion and encourages memorization. Fifteen items can be reviewed in twenty minutes and discussed in another twenty. That is short enough to run before day one and specific enough to reveal a real gap.
Use file scenarios, not definitions
Ask the candidate to read a short file excerpt and decide the next action. Give them a condition, two documents, and a deadline, then ask which document satisfies the condition and what they would record. The answer shows whether they can apply the rule to evidence rather than repeat a definition. Score the decision and the reason, not the wording of the answer.
Include one scenario with a missing page and one with a mismatched name. These are common enough that a new specialist will meet them in the first week. Ask what they would do and who they would tell. The correct answer should include a specific escalation, not a general promise to ask someone.
Add a scenario where the borrower sends a document through the wrong channel. The specialist should recognize the document, record the receipt, and avoid treating the channel as a reason to ignore it. The loan processing support workflow treats channel as a fact to record, not a barrier to intake. A candidate who understands that distinction is ready for the queue.
Include a system navigation task
Knowledge checks often ignore the tools. Give the candidate a sandbox file and ask them to find the last condition note, the borrower's phone number, and the document receipt time. Then ask them to update one field and show where the change is logged. This reveals whether they can work inside the system without creating duplicate records.
Use a sandbox or a training file, never a live borrower record. The check should follow the same access rules as production, including least privilege and no download of sensitive data. If the team cannot provide a sandbox, use a redacted sample and a guided screen share. The point is to test navigation, not to expose information.
Watch how the candidate handles a field they cannot find. A good response is to stop, describe what they see, and ask a precise question. A risky response is to guess and save. The check should reward the pause, because the pause is the control that protects the file.
Ask for a short written handoff
Give the candidate a scenario and ask for a five-line handoff note. The note should state the current stage, the last action, the next action, the owner, and the due date. This tests both writing and judgment, since the candidate must decide which facts matter. A note that includes everything is as unhelpful as one that includes nothing.
Review the note for names, dates, and next actions rather than style. A plain sentence that a processor can act on is better than a polished paragraph that hides the request. The mortgage operations support lead can use the same rubric when sampling live work. Consistency between the check and the review makes the standard credible.
Ask the candidate to mark anything they were unsure about. That list is useful for the first week of coaching and for improving the check itself. When several new hires flag the same item, the training material or the workflow likely needs a fix. A knowledge check should improve the onboarding process, not only score the person.
Set a clear pass standard
Define what a passing result means before the check is used. A common standard is all critical items correct and no more than two minor misses. Critical items include access rules, borrower data handling, and any action that could change a loan decision. A miss on those should trigger reteaching and a retake, not a waiver.
Separate a knowledge gap from a tooling gap. If the candidate knows the rule but cannot find the field, the fix is navigation practice. If the candidate does not know the rule, the fix is training. Recording the reason for each miss makes the retake purposeful and prevents the team from labeling a tooling problem as a performance problem.
Keep the answer key and the scoring rubric in one place, and review them when the workflow changes. The National Association of Mortgage Brokers education resources can help frame general industry expectations, but the check should reflect this team's actual process. A generic industry quiz does not prove readiness for a specific queue. Use the team's own process as the final authority when the general guidance differs.
Run the check before access, not after
Schedule the check before the specialist receives production credentials. That order makes the standard visible and prevents a new person from learning by trial on live files. It also gives the manager a reason to delay access when the check reveals a gap. Access is a control, and the check is one input into it.
Use a short verbal walkthrough after the written check. Ask the candidate to explain one answer and one uncertainty. The conversation reveals whether the written result reflects understanding or a lucky guess. It also gives the candidate a chance to ask questions without feeling penalized.
Repeat a shortened check at the end of the first month. The first check tests readiness, while the second tests retention and catches drift after real work begins. Keep the second check to the items that caused misses or that changed during the month. The goal is a specialist who can work independently without quietly inventing a rule.