Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
exam_construction_and_publishing [2020/01/14 12:39] 70.132.177.124 [Exam Transfer] |
exam_construction_and_publishing [2020/04/28 14:17] (current) 70.132.177.124 |
||
---|---|---|---|
Line 12: | Line 12: | ||
More specific and technical information is provided in the [[https://cpshr.sharepoint.com/:w:/r/teams/PearsonVuePilot/Shared%20Documents/General/3.%20Exam%20Construction%20and%20Publishing/Data%20Flow/_Client_Data_Interchange.docx?d=w38533a2d32364895a1e1ac7b53c472b0&csf=1&e=d3cWbL|Client Data Interchange]], and the [[https://cpshr.sharepoint.com/:b:/r/teams/PearsonVuePilot/Shared%20Documents/General/3.%20Exam%20Construction%20and%20Publishing/Publishing/Pearson_VUE_QTI_Users_Guide%20(v2.19.7).pdf?csf=1&e=jYeegx|QTI Users Guide]]. | More specific and technical information is provided in the [[https://cpshr.sharepoint.com/:w:/r/teams/PearsonVuePilot/Shared%20Documents/General/3.%20Exam%20Construction%20and%20Publishing/Data%20Flow/_Client_Data_Interchange.docx?d=w38533a2d32364895a1e1ac7b53c472b0&csf=1&e=d3cWbL|Client Data Interchange]], and the [[https://cpshr.sharepoint.com/:b:/r/teams/PearsonVuePilot/Shared%20Documents/General/3.%20Exam%20Construction%20and%20Publishing/Publishing/Pearson_VUE_QTI_Users_Guide%20(v2.19.7).pdf?csf=1&e=jYeegx|QTI Users Guide]]. | ||
+ | ==== Exam Level Registration Question ==== | ||
- | ==== Basic Exam Creation ==== | + | The exam level registration question is presented to candidates (a) after they create their online Pearson VUE account, but (b) before they are allowed to schedule a test administration. The registration question is limited to one Prompt, one Response, and one extra set of "Reference Media". The Reference Media will likely contain the bulk of the content and must be shared with Pearson VUE in HTML format. |
+ | The Prompt can be shared with Pearson VUE in rich text, and it should prepare the candidates for what they are about to read. For example, the Prompt could be "I hereby certify that I have read the following Security Agreement and consent to take the examination under the conditions stated herein:". | ||
+ | The Response can be shared with Pearson VUE in rich text, and it should ask candidates to respond to what they just read. For example, the Response could be "By clicking “Agree”, you acknowledge and agree to this course of action. If you refuse to consent to the conditions of this Security Agreement, you will not be authorized to take the examination." | ||
+ | Finally, the Reference Media must be shared with Pearson VUE in HTML format, and it should present candidates with the items to which they must consent/agree/etc. For example, the Reference Media could ask candidates to agree that they "will not make copies of questions or answers from the test". There are many ways to convert text to HTML format. One option is to use the Edit Item Text feature in CE. Response Media can be typed and formatted (in rich text) and then converted to HTMO in the touch of a button. | ||
+ | {{::rich_text_to_hmtl.png?800|}} | ||
- | === License Information === | ||
- | NYC DOB supports a variety of license type/license class [[https://www1.nyc.gov/site/buildings/industry/licensing.page|combinations]]. You may configure those combinations here. | + | ==== Basic Exam Creation ==== |
- | {{:nycdob:nycdob.licenseconfig.png?400|}} | + | **[[https://cpshr.sharepoint.com/:w:/r/teams/PearsonVuePilot/Shared%20Documents/General/3.%20Exam%20Construction%20and%20Publishing/Publishing/SOP%20-%20CE_PV_Exam%20Construction%20and%20Transfer.docx?d=w1562c357b9064987818c5d63cf1b5051&csf=1&e=os2aFj|The SOP for Exam Construction and Transfer is available on SharePoint.]]** |
- | **Note:** You must have one and only one exam configured with a unique pair of license type/class. You can find these settings under Exam -> General Maintenance. | + | Briefly, the process for creating an exam follows the following steps: |
+ | - Exam Build is Completed in CE | ||
+ | - Use CE to build exam | ||
+ | - {{:pearson:pearson.exampublish.png?|400}} | ||
+ | - See [[Sections within the Exam Publish Form]] for more information. | ||
+ | - Export Exam Materials from CE | ||
+ | - {{:pearson:pearson.exampublish.result.png?|400}} | ||
+ | - Compile exam using the QTI Compiler | ||
+ | - Beta test Exam in Navigator | ||
- | {{:nycdob:nycdob.exam.licenseinfo.png?400|}} | ||
- | ====Prerequisites==== | ||
- | Before an exam can be published you must have the exam Pass Mark and the exam Duration values set. Those are found on the Exam - Pass Maintenance form. | ||
- | ====Sections within the Exam Publish form==== | ||
- | {{:pearson:pearson.exampublish.png?400|}} | ||
- | **Select a primary form** | + | ===Prerequisites=== |
- | Only active forms/exams are visible in this list. Select the primary form to be used in the exam publication, then click the "Secondary" button to continue. This will load the secondary form list and also populate the NDA Time and Tutorial Time values. | + | Before an exam can be published you must have the exam Pass Mark and the exam Duration values set. Those are found on the Exam - Pass Maintenance form. |
- | **Select a secondary form (optional)** | ||
- | The secondary form list shows all other exams (not including the primary form) and allows you to associate another form(s) to the exam publication. | ||
- | **Revision Number** will only affect the file name created. | + | === License Information === |
- | **Reporting Group** would involve knowing the data for the Items on the Exam. If the Exam contained Items with Comp A-1, A-2, A-4-5, B-1, B-23 you would expect 5 distinct Competency groupings created in the QTI Assessment file, and the Items would point to those. If Major Competency (A/B) you would only see two groups in the Assessment file. | + | NYC DOB supports a variety of license type/license class [[https://www1.nyc.gov/site/buildings/industry/licensing.page|combinations]]. You may configure those combinations here. |
- | **Assessment Title** | + | {{:nycdob:nycdob.licenseconfig.png?400|}} |
- | {{todo}} | + | **Note:** You must have one and only one exam configured with a unique pair of license type/class. You can find these settings under Exam -> General Maintenance. |
- | **NDA Time** refers to the amount of time that an exam administrator has allocated for test takers to review the exam non-disclosure terms. | + | {{:nycdob:nycdob.exam.licenseinfo.png?400|}} |
- | **Tutorial Time** refers to the amount of time that an exam administrator has allocated for test takers to complete the exam tutorial. | ||
- | **Exam Time** is a value set on the Exam - Pass form, see the field //Duration (Minutes) - required for CBT//. | + | ==== Exam Testing (Navigator) ==== |
+ | **[[https://cpshr.sharepoint.com/:w:/r/teams/PearsonVuePilot/Shared%20Documents/General/3.%20Exam%20Construction%20and%20Publishing/Publishing/SOP_Beta%20Testing_Pearson%20VUE.docx?d=w4fe3ccafbe0249e18ed90fb0b8cca54f&csf=1&e=EqpBIH|A beta testing SOP has been created and is saved to SharePoint]]** | ||
- | **Total Time** is the sum of the exam time + NDA Time + Tutorial Time (in minutes). | + | Also, within Navigator, there is a [[https://navigator.pearsonvue.com/WebHelp/Navigator/start.htm|helpful guide]]. |
+ | ==== Media Deployer ==== | ||
+ | CPS HR has the ability to embed PDFs into the exams. | ||
- | **QTI Section Configuration** | + | This looks like: |
- | There are two pieces to the QTI section configuration. The first is a tree control that lists each of the six QTI exam sections; the second is a grid showing all of the items available to that exam. You may associate one or more items to each of the six sections. To do this: | + | {{:mediadeployer1.png|}} |
- | - Click on a section in the tree | + | |
- | - Select an item from the grid | + | |
- | - Click the +Add button to create the association | + | |
- | - Follow those steps for each of the sections | + | |
- | - You may not add an item to a section if it has been previously added to another section | + | |
- | You may disassociate an item from a section | + | {{:mediadeployer2.png|}} |
- | - Expand the section tree node/text | + | |
- | - Click on the item under the section node/text | + | |
- | - Click the Remove button | + | |
- | - You may not remove any of the base sections | + | |
- | You may reset the section association completely by clicking the Reset button. | + | **[[https://cpshr.sharepoint.com/:w:/r/teams/PearsonVuePilot/Shared%20Documents/General/3.%20Exam%20Construction%20and%20Publishing/Publishing/SOP%20CE_PV%20Media%20Deployer.docx?d=wd0eeaec5e8544dafa45f03fbd3236560&csf=1&e=SQmFcB|An SOP for adding references into an exam has been created and is saved to SharePoint]]** |
- | **Publish** | + | Also, within the Media Deployer part of Navigator, there is a [[https://deployer-cd-prd-1.pearsonvue.com/ContentDeployerApp/help/start.htm|helpful guide]]. |
- | + | ||
- | Once all of the options have been set, click the Publish button. This will start an external process to create the exam files and prepare them to be downloaded. | + | |
- | + | ||
- | **External Process** | + | |
- | + | ||
- | {{:pearson:pearson.exampublish.result.png?400|}} | + | |
- | + | ||
- | As the publish process takes place there will be a series of progress bars indicating the status. Once complete a review of the external process is presented showing the individual and overall outcomes of each of the sub-processes and the final process. | + | |
- | + | ||
- | **Publish Result** | + | |
- | + | ||
- | {{:pearson:pearson.exampublish.zip.png?400|}} | + | |
- | + | ||
- | When the publish has completed you must click the Download Result button, which will save a ZIP file to your local workstation. The ZIP file will then have to be processed by the Pearson-specific tools to validate the constructed exam. Note: this is external to Item Writing functionality and is documented elsewhere. | + | |
- | + | ||
- | + | ||
- | + | ||
- | ==== Exam Testing (Navigator) ==== | + | |
- | ==== Exam Publishing ==== | + | |
- | ==== Media Deployer ==== | + | |
- | ==== Exam Testing with Media ==== | + | |
==== Exam Transfer ==== | ==== Exam Transfer ==== | ||
To provide the exam to Pearson VUE for publishing, a.ZIP folder titled "CPSHR_ENU_####_Rev##" needs to be created, where "ENU" = English language used for exam, "####" = the Exam Series code from CE, and "Rev##" = the reversion number (starts with 01). | To provide the exam to Pearson VUE for publishing, a.ZIP folder titled "CPSHR_ENU_####_Rev##" needs to be created, where "ENU" = English language used for exam, "####" = the Exam Series code from CE, and "Rev##" = the reversion number (starts with 01). | ||
+ | |||
+ | The .ZIP folder should be transferred to Pearson VUE via the FTP site using this file path: /ClientTransfer/FromCPSHR/. | ||
Within this .ZIP folder, there must be the following documents: | Within this .ZIP folder, there must be the following documents: | ||
Line 120: | Line 99: | ||
===== Result Import ===== | ===== Result Import ===== | ||
+ | After candidates test, Pearson VUE uploads the Results to the FTP site. Then, CPS HR copies those files to [[https://teams.microsoft.com/_#/tab%3A%3A6f8d8793-df03-40bf-b0d4-6515a36d5a30/General?threadId=19%3Ad9cfdd7bd92246058953dcceaa039361%40thread.skype&ctx=channel&context=Results|Teams]]/[[https://cpshr.sharepoint.com/teams/CPSPearsonVueResults/Shared%20Documents/Results|SharePoint]]. | ||
+ | |||
+ | Within the folders beginning with "CPSHR_ABE" and ending with the file transfer date, there are two key files. | ||
+ | - examABE-####-##-##-a.dat | ||
+ | - respABE-####-##-##-a.dat | ||
+ | {{:results_abe_files.png?400|}} | ||
+ | |||
+ | These files are used by CE to calculate the results. To begin the process, from CE go to Pearson -> Result Import. | ||
+ | |||
+ | {{:results_import.png|}} | ||
+ | Then upload the "examABE" and "respABE" files to the appropriate locations and select Import. | ||
+ | {{:results_import_2.png|}} | ||
+ | Candidates whose results have been processed will be moved from the Eligible session to a new session that corresponds to the quarter of the year within which the exam was taken. | ||
==== Navigation ==== | ==== Navigation ==== |