Support from FASE's Education Technology Office

How to administer an Administered (in-person) Crowdmark Assessment

Updated on

This guide details how to set up an Administered (paper-based) Assessment in Crowdmark. It provides the steps and resources for creating, printing, scanning, and preparing the assessments for grading. This guide is intended for FASE instructors who are administering in-person assessments and want to use the Crowdmark platform primarily for grading.

What is an administered (paper-based) assessment? Administered assessments are paper-based. They are uploaded in PDF format to Crowdmark where a QR code is added on each page. The assessments are then printed for distribution. After students complete them, they are collected, scanned, and uploaded back into Crowdmark for grading.

Have you arranged scanning for your Crowdmark paper-based Assessments? 

For the Administered Assessment workflow, you organize your own scanning (which requires access to printing and scanning equipment). 

  • First-year FASE course instructors can request (in advance) printing support from the First Year Office and scanning support from the Registrar's Office. 
  • Upper year course instructors should check with their specific department for printing and scanning equipment access and/or support.

Before using Crowdmark for the first time

  1. Log in to Crowdmark
  2. Check if the course you are creating the assignment for is set up in Crowdmark

How to set up your Crowdmark Administered Assessment

1. Prepare your PDF assessment template

An assessment template is the digital version of your questions booklet. This is what you will print and hand out to students. You will need to save your assessment template as a PDF file in order to upload it to Crowdmark and set it up for printing.

You can find example templates and formatting information on Crowdmark's support documentation: Creating an assessment template.

When creating your template, be sure to:

  • leave room under each question for students to write out their answers,
  • leave some space between the top of the page and the questions, the QR codes will be placed in this area,
  • select a paper size that is supported by the printer you will use to print the assessments (in most cases this will be 8.5"x 11" paper)
2. Create New Assessment

Once you have created and saved your PDF template, you can build the assessment in Crowdmark.

  1. Select your course from the list of courses
  2. Select +Create assessment on the Assessments page
3. Add Assessment title
  1. Enter the name of your assessment in the Assessment title field
4. Select Assessment Type - Administered (In-person)
  1. Select the Administered (In-person) assessment type.
5. Select Assessment Status
  1. Select Upcoming assessment option to create a custom assessment with QR codes and auto-matching

There is an upcoming feature called 'Ready for grading' that will allow to grade any assessment using Crowdmark. The feature is still in the development stage; however, Crowdmark offers early access if you would like to test it out. Select Learn more and request early access for the opt-in form.

6. Confirm your selections
  1. Confirm your selections
  2. Select Done
7. Configure your assessment

In the Assessment setup section, you will be able to select options for your assessment and upload the PDF of the assessment template you created.

7.1. Upload and configure template

  1. Select Template section
  2. Drag and drop or select Browse to upload your assessment template in PDF format
  3. Select Page layout: Single-sided or Double-sided (recommended)
    • Double-sided printing: allows for the assessment sheets to be printed double-sided. Crowdmark uses this information for the placement of QR codes in the printable fileIf you leave this option unselected, QR codes will be not be printed on the back of each page. Double-sided printing is recommended to avoid students placing work on pages without QR codes.
  4. Select Auto-matching settings: None or Add auto-matching region to first page
    • Add auto-matching region to first page: will add a region to the cover page of your template for students to write first name, last name and student ID number. Crowdmark will use the information on this page to automatically match the booklets to the students in your Crowdmark roster. Automated matching works best when the Student ID is numeric. See the note below for information on how to upload student number information.  
  5. Select Multiple choice settings. This can add up to 200 multiple choice questions to the assessment, which are answered on a bubble sheet (100 questions per sheet).
  6. Add Extra booklets. It is recommended to add a few extra booklets - you won’t be able to generate more later.

If you’re using bubble sheets for Multiple choice questions, you will need to select Questions on the assessment Dashboard to fill out the Multiple choice answer key that will be used for auto-grading.  

For additional information on using Multiple-Choice Questions in your Administered Assessment, please see the Crowdmark guide: Using multiple choice questions in an administered assessment

Automated Matching considerations and recommendations:

7.2. Preview and save template
  1. Select Generate preview
  2. Select Save template and generate unique booklets to continue with the template setup.

When previewing the pages in your assessment template, check that the QR codes aren't accidentally covering any of the questions.

7.3. Download booklets
  1. Select Download booklets button
8. Label your questions

Crowdmark will add a question label and a points label on each page of your assessment template where it identifies a question.  In the Questions menu, you will be able to:

  • define the location of each question on your template, and
  • edit the question and points labels assigned to each question.

Crowdmark will only detect 1 question per page. If your template includes more than one question per page, you will need to manually add questions to include multiple questions on a single page.

  1. Go to Define your questions section
  2. Select Label questions button
  3. Select Add question label for each question on the page
  4. Set Label and Points. You can drag the label to the desired location on the page if it's different from where Crowdmark placed it automatically
  5. Check off Bonus option if you would like to mark question as bonus (optional)
  6. Select Save button on top of the page after adding labels for each question.

Your assessment is now ready for printing and distributing to students.

Ensure that the points labels for each question match the points values you have added to the questions on the assessment template itself.

How to prepare your assessment for grading in Crowdmark

10. Scan your assessment

After students have written the assessment, you will need to scan the assessment booklets for uploading to Crowdmark and grading. Below is a list of options for scanning your Crowdmark assessments. For each option,

  • use the scanner settings recommended on the Crowdmark guide: Scanning Assessments.
  • remove the staples from the exam booklets (i.e., using scissors or cutter to remove the top left corner of the booklets) ensuring that the QR codes are not cut off
  • ensure that pages are scanned as multi-page PDF (preferred format) or JPG files.
  • ensure that each file you create is under 500 MB in size.

10.1. Scan yourself

You can scan the completed booklets yourself by using a dedicated scanner or the scanning option on your office or departmental printer. If using this option, be sure to scan a few booklets at a time only and align the booklets properly to avoid paper jams.

10.2. Use the BBC Duplicentre scanning services on campus

For large classes, long assessments or other situations where you may not be able to use a departmental scanner, consider using the on-campus services of the BBC Duplicentre, located in the basement of Sidney Smith Hall, University of Toronto (100 St. George Street, Room 516). In addition to printing services, they also offer scanning services.

The approximate cost for 8.5” x 11” pages to be scanned at a minimum 200dpi, with multi-page PDF file returned is:

  • Up to 1000 images - $0.12/per page  
  • 1000+ images - $0.08/per page  

The above costs are approximate and subject to change, HST is extra. Extra charges may be incurred for additional services, including staple removal, pick up and drop off of booklets and scans, external drive or USB required, etc. Please check with the Duplicentre for the most up-to-date pricing.  

10.3. Request scanning support from the FASE Registrar's Office - 1st year FASE courses only

If you are using a Crowdmark Administered assessment in a first-year FASE course (including an Engineering Science course), you can contact the FASE Registrar's Office to ask about scanning support.

11. Manage Scans
  1. Select Manage scans section on your Assignment dashboard for your administered assessment

Each file you upload must be under 500 MB in size. It is not necessary to upload all the booklets as a single PDF file -you can upload the files in batches. If you upload a scanned booklet or page a second time, the new upload will replace the previous one.

11.1. Select your files for uploading

  1. Drag and drop or select Browse button to select scanned files to upload. You can upload multiple files at the same time.
  2. Ensure that the green Complete booklets number matches the number of booklets you collected.

Any upload errors will be indicated in red. To review and fix those errors, see the instructions on the Crowdmark guide: Fixing errors in assessment upload.

11.2. Match the booklets

  1. Select Match booklets under the previous step or on the right-hand navigation menu. If you enabled automated matching when you created your assessment, Crowdmark will automatically match the cover pages that have been uploaded. 

11.3. Troubleshoot matching

If you did not enable automated matching, or if some students could not be matched automatically follow the steps below to manually match the booklets.

  1. Select Manually match booklets on the Match booklets page
  2. Type the student’s information (name, email, or student number) into the search field. The list of students in your course (by email) will be filtered as you type.
  3. If needed, use the left and right arrows to browse booklets.
  4. Select Manual matching arrow to return to the Match booklets section after matching all booklets

For additional information on fixing matching errors, please review the following Crowdmark guides:

Once all the booklets have been matched to students, you're ready to start grading.

Grading in Crowdmark

Grading may be conducted by you or by other members of your teaching team. Before you start grading, ensure you've completed Step 4: Add your Teaching Team to Crowdmark from our guide, How do I connect my Quercus course to Crowdmark?

To help you decide which roles to assign your teaching team members, please refer to the Crowdmark guide: What is the difference between team member roles?

12. Select a question for grading
  1. Go to Grade section on the left-hand side navigation panel of the assessment
  2. Select a question (Q1, for example) to enter the grading interface
13. Enter grades and feedback
  1. Use the grading tools to assign a grade and leave feedback.
  2. Navigate to the next booklet or next question using navigation options.

For a full list of grading tools for different questions types, including comments, stamps, and free-form annotations, review the Crowdmark guide: Grading Tools

For complete instructions on navigating between questions and booklets, review the Crowdmark guide: Grading navigation

14. Manage results of graded assessments

Once all the booklets have been graded, you are able to share the grades with your students and export the grades to Quercus. 

14.1. Return graded assessments to students

  1. Open Results section on the left-hand menu
  2. Add assessment summary message (optional)
  3. Enable/disable display of scores graph distribution for students
  4. Select Return grades button when you are ready to share the grades with students. This will send an email to each student containing a link to their score page, which includes their submission, scores, feedback, and additional information you’ve chosen to include.

What will your students see in Crowdmark when you select the Send grades to students option?  For more information about the student view of the score page, review the Crowdmark guide: What do students see?

14.2. Sync grades with Quercus

  1. Select Sync grades button to add grades to your assessment in a Quercus course. This will create a new Assignment group called Crowdmark Assessments in your Assignments page and a new assignment (with a corresponding gradebook column) with the same name as the Crowdmark assessment.

14.3. Download student data from this assessment

  1. Select Export CSV option to generate a CSV file that can be opened as a spreadsheet and edited in a program like Excel, or imported to the Quercus gradebook using the UT OMR tool
  2. Select the Export PDF option download a local copy of the graded booklets. You may want to keep printed copies of graded assessments to support exam services (i.e., to provide exam copies, and to facilitate grade re-checks or exam re-grading), especially in those cases where you are not releasing the assessments back to students (e.g., for final exams).

Final Exams Copies: Physical copies of final exam booklets (the physical booklets collected from students) written using Crowdmark should be returned to the Registrar's Office where they are kept for one (1) year.

Previous Article Review Crowdmark data use policy
Next Article How can I add accommodations for a Crowdmark Assigned Assessment?
Still have questions? Contact the FASE EdTech Office