AUDIT OVERVIEW

The first tab on the Performance page will show you your audited sessions, your overall audit score percentile in the expert community, and the breakdown of your dimension scores. You can access the specific audit criteria and feedback for each session by clicking on the detail button of the session in question. You can file a dispute for any of your most recent sessions by clicking on the dispute button and following the prompts.

You’ll notice that there are tool tips next to the headings of each metric which will direct you to the relevant training documents.

STUDENT SUCCESS

The middle tab will take you to your student-related metrics including your student ratings, your claimed-but-unanswered (CBU) and low-star rating metrics. Remember to practice all of our best tips and tricks to make sure your students have the best 5-star session experience! The chart will track your student ratings over time and provide the average rating at the top of the page. 

On the other hand, you want your CBU and low-star rating statistics as low as possible. Make sure these metrics don’t get too high or you risk getting your account banned or even permanently suspended.

BIDDING STATISTICS

Navigating to the last tab on the Performance page will take you to your workspace related metrics, including the total number of completed sessions, number of claimed sessions, and other bidding metrics. You can also click on the tooltips next to these metrics to view the relevant training documents to help you improve your performance.

You can adjust the timeframe for these metrics to view the most recent ones (the current date, the last 7 days, 30 days, 90 days) or adjust to set your own custom date range. You can also view and select your metrics for different subjects that you are certified for.

At Got It! our core values are helping students learn while always providing useful information and interactions.  We want to ensure a positive experience by providing consistent and accurate explanations.

What parts make up a great student experience?

• Explain each step while solving a problem, beginning with the general knowledge needed to solve the problem
• Present a visually appealing and easy to understand explanation
• Demonstrate polite, friendly, and helpful customer service that is attentive to students’ needs and questions
• Answer accurately and consistently
• Provide safe, non-personalized interactions

As such, we’ve developed 5 categories on which Experts are audited:

1. Format — the structure in which the explanation breaks down the problem into logical steps to solve the problem
2. Polish — the ease of reading through the explanation
3. Service — the manner in which the explanation is conducted
4. Accuracy — the correctness of the explanation and solution
5. PII (personal identifiable information) — the anonymity within the learning sessions

This FAQ is pivotal to understanding the guidelines to which Auditors review a session.  All Experts are strongly encouraged to read through this document and understand it completely.

 FORMAT

4 criteria are used to score for Format:

• Proper concept, method, or general steps to solve the problem
• Step-by-step math
• Step-by-step worded explanation
• Piece-by-piece explanation and timing of overall explanation

At Got It!, we value learning by providing explanations, not just giving answers.  Any explanation that solely provides answers will receive the lowest score automatically.

This is an example of an ‘A’ score.  Note how the example satisfies all 4 criteria.

This is an example of a ‘B’ score.  Note how the example satisfies only 3 out of 4 criteria since it does not piece out the explanation and sends it in one big message several minute after the concept.

This is an example of a ‘C’ score.  Note how the example satisfies only 2 out of 4 criteria since the concept is unhelpful and the explanation is not pieced out.

This is an example of a ‘D’ score.  Note how the example only provides the answer to the question.  This is an automatic D score.

POLISH

2 questions to consider when creating your explanation:

• Is it necessary to use the editors/tools available given the problem at hand?
• If so, were the editors/tools used appropriately?

At Got It!, we expect our sessions to be polished and easy to understand.  We have a number of tools available to craft beautiful explanations, so please visit the Portal Tools section of the Training – FAQ section.

This is an example of a ‘No’ score.  Note how much more difficult it is to understand the math.

This is an example of an ‘N/A’ score.  Note how the question asked does not warrant a response with editor usage.

SERVICE

4 criteria are used to score for Service:

• Conduct: Polite and helpful tone
• Conduct: Proper English in grammar, spelling, and full sentences
• Interaction: Addressing student questions and frustrations with appropriate context
• Interaction: Addressing student questions and frustrations with appropriate timing (< 1 min response)

At Got It!, we know students are frustrated and anxious when stuck on a problem — and that learning goes beyond content and knowledge.  A good session will not only provide the necessary explanation to become unstuck, but also to alleviate these anxieties and promote learning.

Our service criteria is broken up into two categories — Conduct & Interaction

• Conduct — Assesses for how an Expert carries him/herself through a session.  Proper conduct must be carried out in all sessions to ensure a friendly and helpful environment to learn.
• Interaction — Assesses the exchange in messages between student and Expert.  Not all sessions will have a talkative student, but for the ones that do, Experts must engage with the student by answering questions appropriately or calming the student if he/she is frustrated.

This is an example of meeting 2 out of 2 criteria for Conduct.  Note the proper English and tone.

This is an example of meeting only 1 out of 2 criteria for Conduct.  Note the proper English but rudeness in tone.

This is an example of meeting 0 out of 2 criteria for Conduct.  Note the improper English and rudeness in tone.

This is an example of meeting 2 out of 2 criteria for Interaction.  Note the proper addressing of the message contextually and timely — the Expert calms the student’s frustration while answering the message in less than a minute.

This is an example of meeting 1 out of 2 criteria for Interaction.  Note the improper addressing of the message contextually but proper addressing timely — the Expert does not address the student’s “help me” and continues to the explanation.

This is an example of meeting 0 out of 2 criteria for Interaction.  Note the improper addressing of the message contextually and timely — the Expert does not address the student’s “i don’t know what to do” and continues to the explanation several minutes later, leaving the student frustrated for half the session with no information given.

In addition, please visit the New Portal Improvement FAQ for a new feature that prompts the student to give a suggested response during the session.  We will ask the student for you if they understand the explanation thus far — if the student selects “No, I need more detail” it is the Expert’s responsibility to address that response with proper context and within a timely manner.

This is an example of meeting 2 out of 2 criteria for Interaction for suggested response.  Note the proper addressing of the message contextually and timely.

This is an example of meeting 1 out of 2 criteria for Interaction for suggested response.  Note the improper addressing timely but proper addressing of the message contextually — the Expert provides more detail for the explanation but does not do so within the minute.

This is an example of meeting 0 out of 2 criteria for Interaction for suggested response.  Note the improper addressing of the message contextually and timely — the Expert does not address the student’s “which is the result”, does not provide much more detail, and does not answer within the minute.

ACCURACY

In order for students to trust Got It!,  we need to ensure our explanations are complete and accurate.  Since this is such an important category, we have created a separate FAQ for how to ensure accurate sessions.  For more information please see the Accuracy FAQ.

Accuracy is scored a simple Yes, No, or Not Applicable.  For more information please see the Audit Scoring FAQ.

PII

At Got It!, we protect the identities of our Experts and students to ensure a safe and anonymous learning environment.  As such, we expect our Experts and students to never ask or provide personal information.  If found to provide or elicit PII (personal identifiable information), the Expert or student will be immediately removed from the platform.

Possible PII includes but is not limited to:

• Usernames of Got It! accounts or any other medium/sites
• Links or images to any profiles of any medium/sites
• E-mails
• Phone numbers
• Addresses

This is an example of a PII violation.  The Expert was immediately terminated, regardless of his quality of work.

Accuracy

While working as a Study Expert, accuracy is extremely important at Got It! Students come to Got It! for accurate explanations of problems they are stuck on and incorrect explanations cause students to never return and decrease question flow.

Our auditing program identifies inaccurate explanations regularly and depending on the number of violations, these Experts are suspended or have their contracts permanently terminated.

Accuracy is also a key part of your Expert performance.  So always be sure you’re giving accurate explanations to the precise question that was asked!

What are some methods to help you provide accurate explanations?

• Read and understand each problem before bidding
  • Experts sometimes bid on questions that they can’t actually solve. This might be because of the explanation time limit or due to the difficulty of the subject matter. Experts that claim questions they cannot explain waste students’ time and give an extremely poor user experience. This also hurts your accuracy scores. The skip option is available to prevent these situations. Skip when you’re not sure!
• Confirm with the student the correct question and their understanding.
  • Sometimes it’s unclear to Experts which question the student needs help with or which part of the problem is unclear to the student. Engaging with the students in these types of dialogues guarantees you will not explain the wrong question and also helps you explain the difficult part more efficiently to the student.
• Pay attention to the requirements of questions posted from an online platform.
  • These types of questions normally come with super specific requirements, such as units, decimal places, and presentation format. Students can instantly check for the accuracy of your delivered answers right after you submit them. And a mathematically correct solution but in the wrong format as required by the system will highly likely result in a low student rating. Therefore, it’s crucial to read the question carefully and double-check your work to make sure it meets all the requirements before wrapping up your session.
• Wolfram Alpha
  • Not every problem can be solved by Wolfram Alpha, but some can. It’s highly encouraged to enter your problems into Wolfram Alpha when applicable to check if your explanation is correct. If Wolfram Alpha confirms your explanation then you can be even more confident that your concept/theory and explanation are also correct.
• Take your time
  • Students might ask “Hurry!” or threaten low ratings based on speed. This can cause pressure and stress but in the long run, rushing through your explanation can result in inaccurate explanations and eventual contract termination.
• Double-check your work
  • We know the timer is ticking and the student is sometimes in a hurry. Regardless, the last thing a student expects is an inaccurate explanation. Double-checking your work significantly improves accuracy rates.

Examples

Here are 2 examples of questions with super clear requirements for the submitted final solutions:

Below please find some examples of sessions marked inaccurate for very simple mistakes caused by rushing and not double-checking work. These often result in suspension and even termination of the contract.

You’ll notice below that the Expert made a simple calculation error. The equation would be 14,850,000/x – 14,850,000/(x+2200)=75.  After solving this we are left with 19,800.  The Expert listed 1,98,000 and therefore his answer was marked as inaccurate.

Example 1:

Question:

Answer:

In this second example, we can see a simple calculation error. If you look at the problem below, it clearly says “the length of a rectangle is 3 more than its width.” One of the equations is l=3+w but the Expert wrote l=3*w.  This resulted in an incorrect answer because of this error and therefore is marked as inaccurate.

Question 2:

Answer 2:

Remember Experts, everyone is audited so please make sure to use the suggested actions above to protect yourself from providing inaccurate answers.

I’VE BEEN SUSPENDED!

…now what? What does this mean?

Here at Got It!, we’ve developed a product we truly believe in — with Experts of the highest caliber to carry out this product and deliver quality content.  Since Experts (such as yourselves) are such a major component of this product, we need to ensure all sessions and actions within the platform continue to perform at the desired quality and capacity.  As such, our Got It! policies were created and enforced — it is the lack of following these policies that may need to one of the following disciplinary actions:

• Suspension — 3 to 30 days temporary suspension
• Decertification — removal of a subject
• Off-boarding — permanent ban

Disciplinary Triggers

Sessions are subject to auditing for the 5Ds of our company policy and are given ratings by our student users.  Low audit scores trigger temporary suspension while multiple audit scores and multiple low student ratings result in decertification or off-boarding.  The details for which these triggers are below:

• Suspension
  • Format score of D
  • Service score of D
  • Accuracy score of No (specifically for the wrong concept used)
• Decertification
  • Multiple Accuracy scores of No
  • Multiple low student ratings
  • Multiple claimed but unanswered (CBU) sessions
• Off-boarding
  • Multiple Format scores of C or D
  • Multiple Service scores of C or D
  • PII score of Yes

In addition, we expect all experts to maintain a level of professional behavior when talking in session.  As such, behavioral actions may also trigger disciplinary action.  This includes but does not limit to:

• Use of profanity or rudeness to student
• Unprofessional behavior
• Collusion/fraud

Early prevention

To steer clear of violating our disciplinary regulations, consider these practical suggestions:

1. Attentiveness to Audit Feedback: Carefully review feedback provided by auditors. This will help you pinpoint areas in your explanations that require enhancement. Strive to incorporate these improvements in your subsequent sessions.
2. Mitigation of Incomplete Sessions (CBU – Claimed But Unanswered): Refrain from delivering an excessive number of incomplete sessions, where you claim questions but don’t provide answers. A general guideline is to maintain a CBU rate below 18%.
3. Caution Regarding Low Ratings: Keep in mind that students might occasionally leave unjustified ratings, which have a limited impact on your overall student rating score. If you consistently receive low ratings, consider taking a break, reviewing auditor feedback, and revisiting the training material focused on achieving 5-star ratings from students here.

Other useful information

• How can I tell how long I’ve been suspended?
  • You will receive an e-mail communication regarding the details of your suspension.  In addition, when you attempt to log into the Expert Portal, you will receive a time and date (in Central Time) for when your suspension will be lifted.
• Does receiving a warning or suspension affect my ranking?
  • No, the two are separate processes.  However, audit scores are the key influences to both ranking and disciplinary actions.
• Can I get suspended or off-boarded while I’m still logged into the Expert Portal?
  • Yes, the suspension and off-boarding will log you off the Expert Portal and provide you with the expected time and date (again, in Central Time) for when you can re-enter.