SlideShare a Scribd company logo
1 of 41
Download to read offline
Fire & Police Selection, Inc. Hiring the Most Qualified Firefighters…. … While Avoiding  (and Defending) Lawsuits
Contact Information Dan A. Biddle, Ph.D. Stacy L. Bell, M.S. CEO, Biddle Consulting Group, Inc./Fire & Police Selection, Inc. 193 Blue Ravine, Ste. 270 Folsom, CA 95630 1-888-990-3473 www.biddle.com  |  www.FPSI.com Email:  dan@biddle.com | s [email_address]
Biddle Consulting Group, Inc. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Industry Leader
Fire & Police Selection, Inc. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Fire & Police Selection, Inc. ,[object Object],[object Object],[object Object],[object Object],[object Object]
Approach to Test Validation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The Quickly Changing Climate of Personnel Testing…
Adverse Impact & Test Validation -Uniform Guidelines & Civil Rights Act of 1991 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
How Can Testing Practices be Challenged? Title VII Disparate Impact Discrimination Flowchart “ OR ” Practice, Procedure, or Test (PPT) Adverse Impact? YES NO Is the PPT Valid? YES NO Alternative  Employment Practice? NO Defendant Prevails YES Plaintiff  Prevails END Plaintif f   Prevails
Validation Standards ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
What is Validation? ,[object Object],[object Object]
Uniform Guidelines Style Validation… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
What Types of Validation are REALLY USED in Practice?   ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],Content Validity
Content Validity Essential #1: Job Analysis Research ,[object Object],[object Object],[object Object]
What Ratings are Typically Collected During a Content Validity Job Analysis? (Level 2-3) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],* = required under federal Guidelines for Content Validity
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],* = required under federal Guidelines for Content Validity What Ratings are Typically Collected During a Content Validity Job Analysis? (Level 2-3)
Content Validity Essential #2: Targeting Key KSAs for Test Building ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Firefighter Job Analysis  Duties   Sample yes yes 4 4.00 8.25 Takes inventory and records and reports equipment and apparatus missing or needing repair or replacement. A3 no yes 4 3.13 8.25 Recognizes the need and makes recommendations for entries in daily log. A2 no yes 5 4.88 8.75 Arrives on time, receives and follows orders, instructions, regarding the work to be done. A1 Assignable  Fundamental  Best Worker  Importance  Frequency  Domain A  Station Duties   Supervisor Ratings Firefighter/EMT-I, Firefighter-PM and Fire Engineer Duties  
Firefighter Job Analysis  KSAPCs   Sample 3 1 HQ 4.13 6.38 A5, A20, C6, F11 Ability to maintain respect for other’s emotional needs following a crisis. O55 4 1 MQ 4.63 7.63 A5, A20, E1, F8, G2 Willing to remain calm under pressure or heavy workloads, not easily given to hostility, anxiousness, or vulnerability.  Wiling to make sensible decisions under pressure. O54 4 1 MQ 4.13 7.25 A1, A2, A24, C5 Willing to be resourceful, goal-oriented, and proactive in bringing tasks to completion.  O53 Level Needed  Upon Entry Best Worker MQ vs. HQ Importance Frequency This KSAPC is linked to the following duties. Domain O  Knowledges, Skills, Abilities, and Personal Characteristics (KSAPCs) :  The following knowledge skills, abilities, and personal characteristics affect work behavior and are necessary or important for successful job performance.   Supervisor Ratings Firefighter/EMT-I, Firefighter-PM, and Fire Engineer KSAPCs      
Selection Plan ,[object Object],[object Object],[object Object],[object Object],[object Object]
Selection Plan— Sample  *The score from this selection procedure will be combined with scores from other selection procedures in the selection process. P/F MQ 3.1 N/A 3.5 1.4 Basic math skills MQ 3.4 N/A 3.9 1.9 Upper body strength P/F MQ 3.9 3.4 3.5 2.6 Knowledge of Fire Codes R MQ 3.7 N/A 3.5 3.9 Verbal communication skills R MQ 4 N/A 3.2 4.2 Interpersonal and team work skills Background Check Structured  Interview Written Test Application Form Minimum/Helpful Qualification (MQ/HQ) Importance (1-5) Level Needed (Knowledges Only) (1-4) Level Needed Upon Entry (1-4) Best Worker (1-5) Knowledge, Skills, Ability, Personal Characteristic, or Physical Requirement Selection Procedure and Use ( P ass/Fail,  R ank, or  C ombine*) KSAPC/Physical Requirement Rating KSAPC/ Phys Req.
Job  Duties Operationally defined KSAOs Other KSAOs Selection  Devices (e.g., application form, tests, interviews) Content Validity Essential #3: Connecting the Test to the Job Content Valid!
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Content Validity Essential #4:  (Test Usage)
Using Test Scores ,[object Object],[object Object],[object Object]
Pass/Fail Cutoffs ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Using Test Scores ,[object Object],[object Object],[object Object],[object Object]
Comparison Between “Test Use” Options Low Moderate High # Item Requirements Low Moderate High Reliability Requirements High Moderate Low  Development Time High Moderate/Controllable Restrictive/Controllable Applicant Flow High Moderate Low  Cost Low Moderate High Utility Low Moderate High Litigation "Red Flag" High High Low  Defensibility Low Moderate High Adverse Impact Low Moderate High Validation Requirements Pass/Fail Cutoffs Banding Ranking Factor
Weighting/Combining Scores Some thoughts... Job Performance Cognitive  Ability Experience/ Background Interpersonal Personality Factors
Sample Data—Cognitive and Personality Test Scores  Total Scores 156 69 W M 175 70 W F 161 70 B M 158 71 B M M M M Gender W B W Ethnicity 63 68 72 Cognitive Score 156 225 175 Personality Score
Sample Data—Cognitive and Personality Test Scores  Combined Test Scores M M M M F M M Gender W W B B W B W Ethnicity 63 69 70 71 70 68 72 Cognitive  % Score 156 156 161 158 175 225 175 Personality Score 73% 79% 81% 81% 81% 83% 83% Combined % Score
Steps for Weighting Tests Using Content Validity Methods ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Standardizing Scores ,[object Object],[object Object],[object Object],[object Object]
Building a Balanced Hiring Program by Sorting the Key Firefighter Competencies for Success ,[object Object],[object Object],[object Object],[object Object]
U.S. Fire Department Input & Opinions Personal Characteristics 55% Cognitive/Academic Skills & Abilities 45% National Fire Select Test™ Cognitive/Academic Component Strategic Decision- Making 14% Problem Solving 14% Map Reading 10% Writing Ability 15% Reading Ability 18% Mathematical Reasoning 15% Mechanical Ability 14% Personal Characteristics Component Thoroughness/ Attention To Detail 9% Public Relations 9% Sensitivity 8% Emotional Stability 10% Proactive/ Goal-Oriented 8% Truthfulness/ Integrity 13% Allegiance/ Loyalty 10% Working Under Stress 10% Teamwork 12% Following Orders 11%
Proposed Solutions for Testing Cognitive/Academic Competencies  for Entry-Level Firefighters Notes: CV: Content Validity; CRV: Criterion-related validity. CV/CRV Using CV, measure mechanical comprehension skills such as leverage, force, and mechanical/ physics contexts regarding weights, shapes, and distances. Also can measure spatial reasoning (when using a CRV validation strategy). 12% Mechanical Ability CV While a Structured Interview is the best tool for measuring this skill (because the applicant can be asked to apply this skill in firefighter-specific scenarios), some level of this skill can be measured using word problems or other contexts supplied in written format where applicants can consider cause/effect of certain actions. 13% Strategic Decision-Making CRV Measure using word problems measuring reasoning skills in job-rich contexts. 15% Problem-Solving CV Measure using maps and related questions asking applicants how they would maneuver to certain locations. Include directional awareness. 8% Map Reading CV Measure using writing passages or word recognition lists, sentence clarity, and/or grammar evaluation items. 12% Writing CV While a Structured Interview is the best tool for measuring this skill (because the skill includes verbal and non-verbal aspects), some level of this skill can be measured using word recognition lists or sentence clarity items. 15% Verbal Communication CV Measure using either (1) “Test Preparation Manual” approach (where applicants are given a manual and asked to study it for a few weeks prior to taking the test based on the Manual);  or (2) a short reading passage containing material at a similar difficulty/context to the job that applicants are allowed to study during the testing session and answer related test items. 14% Reading CV Use written or “work sample” format; measure using a limited number of multiple-choice items. Balance various types of math skills (add/subtract/multiple,  etc.). 10% Math Typical Validation Method Proposed Testing Solution Weight Cognitive/Academic (45% Overall Importance)
Proposed Solutions for Personal Characteristics  for Entry-Level Firefighters Notes: CV: Content Validity; CRV: Criterion-related validity. 11% Following Orders 9% Thoroughness/Attention to Detail CV/CRV These competencies can be effectively measured using either an SJT (using a CV or CRV strategy) or a  Conscientiousness (CS) scale (using a CRV strategy). A CS test can be developed using just 20-30 items (using likert- type responses). Such tests are typically successful in predicting job performance in fire settings. 8% Proactive/Goal-Oriented 8% Sensitivity 10% Emotional Stability 9% Public Relations 13% Truthfulness/Integrity 10% Allegiance/Loyalty 10% Working Under Stress CV/CRV Under a CV strategy, a Situational Judgment Test (SJT) can be used for measuring these skills. Alternatively, a custom personality test can be developed using CRV. while these types of assessments can measure  if an applicant knows  the most appropriate response (using an SJT) or the best attitude or disposition (personality test), they are limited in that they cannot measure whether an applicant  would actually respond  in such a way. For these reasons, measuring the  underlying traits  that tend to generate these positive behaviors is typically the most effective strategy. Structured Interviews can also provide useful insight into these types of competencies, as well as background and reference evaluations. However, these tools are time consuming and expensive, so measuring these areas in the testing stage is an effective strategy. 12% Teamwork Typical Validation Method Proposed Testing Solution Weight Personal Characteristics (55% Overall)
Selecting the Ideal Firefighter Critical Skills & Abilities Test “A” Test “B” Reading Ability Mathematical Ability Spatial Abilities Mechanical Aptitudes Writing Ability Interpersonal Skills Decision Making Test “C” Map Reading NFST™
Challenges to Building a Balanced Testing Program and Recommendations for Success ,[object Object],[object Object],[object Object]
Failure to Use a “Balanced Test”   ,[object Object],[object Object],[object Object],[object Object],[object Object]
Fire & Police Selection, Inc.  Contact us at: ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

More Related Content

Similar to Hiring the Most Qualified Firefighter While Avoiding Lawsuits

Topic7.1c2 compensation how_to_createa_market-competitive_payplannew
Topic7.1c2 compensation how_to_createa_market-competitive_payplannewTopic7.1c2 compensation how_to_createa_market-competitive_payplannew
Topic7.1c2 compensation how_to_createa_market-competitive_payplannewtellstptrisakti
 
Maintaining Physical Standards Using Physical Ability Tests Are Your Incumben...
Maintaining Physical Standards Using Physical Ability Tests Are Your Incumben...Maintaining Physical Standards Using Physical Ability Tests Are Your Incumben...
Maintaining Physical Standards Using Physical Ability Tests Are Your Incumben...stacybell
 
КАТЕРИНА АБЗЯТОВА - Certify with confidence: ISTQB Foundation 4.0. Common err...
КАТЕРИНА АБЗЯТОВА - Certify with confidence: ISTQB Foundation 4.0. Common err...КАТЕРИНА АБЗЯТОВА - Certify with confidence: ISTQB Foundation 4.0. Common err...
КАТЕРИНА АБЗЯТОВА - Certify with confidence: ISTQB Foundation 4.0. Common err...GoQA
 
Competency based (19.07.2013)
Competency based (19.07.2013)Competency based (19.07.2013)
Competency based (19.07.2013)Theint Htun
 
Workshop on Training Needs Analysis
Workshop on Training Needs AnalysisWorkshop on Training Needs Analysis
Workshop on Training Needs AnalysisNestor Fraga
 
Less01 1 introduction_module
Less01 1 introduction_moduleLess01 1 introduction_module
Less01 1 introduction_moduleSuresh Mishra
 
Distance learning study guide managing resources unit 2
Distance learning study guide managing resources unit 2Distance learning study guide managing resources unit 2
Distance learning study guide managing resources unit 2Fred Lewis
 
Chris_Fukuda_Resume_2022.doc
Chris_Fukuda_Resume_2022.docChris_Fukuda_Resume_2022.doc
Chris_Fukuda_Resume_2022.docChrisFukuda
 
Examiners-Reports-from-June-2008-NGC1-Only_March-2009-NGC1[1].pdf
Examiners-Reports-from-June-2008-NGC1-Only_March-2009-NGC1[1].pdfExaminers-Reports-from-June-2008-NGC1-Only_March-2009-NGC1[1].pdf
Examiners-Reports-from-June-2008-NGC1-Only_March-2009-NGC1[1].pdfabdulazeem639989
 
Er 2012 mar IGC1 CP March 20123052012561038.pdf
Er 2012 mar IGC1 CP March 20123052012561038.pdfEr 2012 mar IGC1 CP March 20123052012561038.pdf
Er 2012 mar IGC1 CP March 20123052012561038.pdfabdulazeem639989
 
Dual qualification curriculum presentation (march 2012)
Dual qualification curriculum presentation (march 2012)Dual qualification curriculum presentation (march 2012)
Dual qualification curriculum presentation (march 2012)sjbisluk
 
Examiners-Report-NEBOSH-IGC1-March-2009.pdf
Examiners-Report-NEBOSH-IGC1-March-2009.pdfExaminers-Report-NEBOSH-IGC1-March-2009.pdf
Examiners-Report-NEBOSH-IGC1-March-2009.pdfabdulazeem639989
 
Examiners-Report-NEBOSH-IGC1-March-2009.pdf
Examiners-Report-NEBOSH-IGC1-March-2009.pdfExaminers-Report-NEBOSH-IGC1-March-2009.pdf
Examiners-Report-NEBOSH-IGC1-March-2009.pdfabdulazeem639989
 
Job reclassification
Job reclassificationJob reclassification
Job reclassificationLuis Baquero
 

Similar to Hiring the Most Qualified Firefighter While Avoiding Lawsuits (20)

Topic7.1c2 compensation how_to_createa_market-competitive_payplannew
Topic7.1c2 compensation how_to_createa_market-competitive_payplannewTopic7.1c2 compensation how_to_createa_market-competitive_payplannew
Topic7.1c2 compensation how_to_createa_market-competitive_payplannew
 
Maintaining Physical Standards Using Physical Ability Tests Are Your Incumben...
Maintaining Physical Standards Using Physical Ability Tests Are Your Incumben...Maintaining Physical Standards Using Physical Ability Tests Are Your Incumben...
Maintaining Physical Standards Using Physical Ability Tests Are Your Incumben...
 
КАТЕРИНА АБЗЯТОВА - Certify with confidence: ISTQB Foundation 4.0. Common err...
КАТЕРИНА АБЗЯТОВА - Certify with confidence: ISTQB Foundation 4.0. Common err...КАТЕРИНА АБЗЯТОВА - Certify with confidence: ISTQB Foundation 4.0. Common err...
КАТЕРИНА АБЗЯТОВА - Certify with confidence: ISTQB Foundation 4.0. Common err...
 
Competency-based Management for the DoD-wide Contracting Community
Competency-based Management for the   DoD-wide Contracting CommunityCompetency-based Management for the   DoD-wide Contracting Community
Competency-based Management for the DoD-wide Contracting Community
 
Competency based (19.07.2013)
Competency based (19.07.2013)Competency based (19.07.2013)
Competency based (19.07.2013)
 
Workshop on Training Needs Analysis
Workshop on Training Needs AnalysisWorkshop on Training Needs Analysis
Workshop on Training Needs Analysis
 
ASTD Federal Job Search
ASTD Federal Job Search ASTD Federal Job Search
ASTD Federal Job Search
 
Less01 1 introduction_module
Less01 1 introduction_moduleLess01 1 introduction_module
Less01 1 introduction_module
 
Distance learning study guide managing resources unit 2
Distance learning study guide managing resources unit 2Distance learning study guide managing resources unit 2
Distance learning study guide managing resources unit 2
 
Chris_Fukuda_Resume_2022.doc
Chris_Fukuda_Resume_2022.docChris_Fukuda_Resume_2022.doc
Chris_Fukuda_Resume_2022.doc
 
Examiners-Reports-from-June-2008-NGC1-Only_March-2009-NGC1[1].pdf
Examiners-Reports-from-June-2008-NGC1-Only_March-2009-NGC1[1].pdfExaminers-Reports-from-June-2008-NGC1-Only_March-2009-NGC1[1].pdf
Examiners-Reports-from-June-2008-NGC1-Only_March-2009-NGC1[1].pdf
 
Human Resources 101
Human Resources 101Human Resources 101
Human Resources 101
 
Er 2012 mar IGC1 CP March 20123052012561038.pdf
Er 2012 mar IGC1 CP March 20123052012561038.pdfEr 2012 mar IGC1 CP March 20123052012561038.pdf
Er 2012 mar IGC1 CP March 20123052012561038.pdf
 
Dual qualification curriculum presentation (march 2012)
Dual qualification curriculum presentation (march 2012)Dual qualification curriculum presentation (march 2012)
Dual qualification curriculum presentation (march 2012)
 
Examiners-Report-NEBOSH-IGC1-March-2009.pdf
Examiners-Report-NEBOSH-IGC1-March-2009.pdfExaminers-Report-NEBOSH-IGC1-March-2009.pdf
Examiners-Report-NEBOSH-IGC1-March-2009.pdf
 
Examiners-Report-NEBOSH-IGC1-March-2009.pdf
Examiners-Report-NEBOSH-IGC1-March-2009.pdfExaminers-Report-NEBOSH-IGC1-March-2009.pdf
Examiners-Report-NEBOSH-IGC1-March-2009.pdf
 
Test design techniques
Test design techniquesTest design techniques
Test design techniques
 
Job reclassification
Job reclassificationJob reclassification
Job reclassification
 
Fundamentals of testing
Fundamentals of testingFundamentals of testing
Fundamentals of testing
 
Module 5 evaluating safety messages and training
Module 5   evaluating safety messages and trainingModule 5   evaluating safety messages and training
Module 5 evaluating safety messages and training
 

Recently uploaded

Upgrade Your Banking Experience with Advanced Core Banking Applications
Upgrade Your Banking Experience with Advanced Core Banking ApplicationsUpgrade Your Banking Experience with Advanced Core Banking Applications
Upgrade Your Banking Experience with Advanced Core Banking ApplicationsIntellect Design Arena Ltd
 
Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access
 
Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access
 
Tata Kelola Bisnis perushaan yang bergerak
Tata Kelola Bisnis perushaan yang bergerakTata Kelola Bisnis perushaan yang bergerak
Tata Kelola Bisnis perushaan yang bergerakEditores1
 
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHelene Heckrotte
 
Lecture_6.pptx English speaking easyb to
Lecture_6.pptx English speaking easyb toLecture_6.pptx English speaking easyb to
Lecture_6.pptx English speaking easyb toumarfarooquejamali32
 
Team B Mind Map for Organizational Chg..
Team B Mind Map for Organizational Chg..Team B Mind Map for Organizational Chg..
Team B Mind Map for Organizational Chg..dlewis191
 
Anyhr.io | Presentation HR&Recruiting agency
Anyhr.io | Presentation HR&Recruiting agencyAnyhr.io | Presentation HR&Recruiting agency
Anyhr.io | Presentation HR&Recruiting agencyHanna Klim
 
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...Khaled Al Awadi
 
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003believeminhh
 
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...Brian Solis
 
NASA CoCEI Scaling Strategy - November 2023
NASA CoCEI Scaling Strategy - November 2023NASA CoCEI Scaling Strategy - November 2023
NASA CoCEI Scaling Strategy - November 2023Steve Rader
 
Data skills for Agile Teams- Killing story points
Data skills for Agile Teams- Killing story pointsData skills for Agile Teams- Killing story points
Data skills for Agile Teams- Killing story pointsyasinnathani
 
Slicing Work on Business Agility Meetup Berlin
Slicing Work on Business Agility Meetup BerlinSlicing Work on Business Agility Meetup Berlin
Slicing Work on Business Agility Meetup BerlinAnton Skornyakov
 
MC Heights construction company in Jhang
MC Heights construction company in JhangMC Heights construction company in Jhang
MC Heights construction company in Jhangmcgroupjeya
 
Developing Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, OursDeveloping Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, OursKaiNexus
 
Project Brief & Information Architecture Report
Project Brief & Information Architecture ReportProject Brief & Information Architecture Report
Project Brief & Information Architecture Reportamberjiles31
 
Cracking the ‘Business Process Outsourcing’ Code Main.pptx
Cracking the ‘Business Process Outsourcing’ Code Main.pptxCracking the ‘Business Process Outsourcing’ Code Main.pptx
Cracking the ‘Business Process Outsourcing’ Code Main.pptxWorkforce Group
 
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISING
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISINGUNLEASHING THE POWER OF PROGRAMMATIC ADVERTISING
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISINGlokeshwarmaha
 

Recently uploaded (20)

Upgrade Your Banking Experience with Advanced Core Banking Applications
Upgrade Your Banking Experience with Advanced Core Banking ApplicationsUpgrade Your Banking Experience with Advanced Core Banking Applications
Upgrade Your Banking Experience with Advanced Core Banking Applications
 
Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024
 
Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024
 
Tata Kelola Bisnis perushaan yang bergerak
Tata Kelola Bisnis perushaan yang bergerakTata Kelola Bisnis perushaan yang bergerak
Tata Kelola Bisnis perushaan yang bergerak
 
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
 
Lecture_6.pptx English speaking easyb to
Lecture_6.pptx English speaking easyb toLecture_6.pptx English speaking easyb to
Lecture_6.pptx English speaking easyb to
 
Team B Mind Map for Organizational Chg..
Team B Mind Map for Organizational Chg..Team B Mind Map for Organizational Chg..
Team B Mind Map for Organizational Chg..
 
Anyhr.io | Presentation HR&Recruiting agency
Anyhr.io | Presentation HR&Recruiting agencyAnyhr.io | Presentation HR&Recruiting agency
Anyhr.io | Presentation HR&Recruiting agency
 
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...
 
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
 
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
 
NASA CoCEI Scaling Strategy - November 2023
NASA CoCEI Scaling Strategy - November 2023NASA CoCEI Scaling Strategy - November 2023
NASA CoCEI Scaling Strategy - November 2023
 
Data skills for Agile Teams- Killing story points
Data skills for Agile Teams- Killing story pointsData skills for Agile Teams- Killing story points
Data skills for Agile Teams- Killing story points
 
Slicing Work on Business Agility Meetup Berlin
Slicing Work on Business Agility Meetup BerlinSlicing Work on Business Agility Meetup Berlin
Slicing Work on Business Agility Meetup Berlin
 
MC Heights construction company in Jhang
MC Heights construction company in JhangMC Heights construction company in Jhang
MC Heights construction company in Jhang
 
Developing Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, OursDeveloping Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, Ours
 
Project Brief & Information Architecture Report
Project Brief & Information Architecture ReportProject Brief & Information Architecture Report
Project Brief & Information Architecture Report
 
WAM Corporate Presentation Mar 25 2024.pdf
WAM Corporate Presentation Mar 25 2024.pdfWAM Corporate Presentation Mar 25 2024.pdf
WAM Corporate Presentation Mar 25 2024.pdf
 
Cracking the ‘Business Process Outsourcing’ Code Main.pptx
Cracking the ‘Business Process Outsourcing’ Code Main.pptxCracking the ‘Business Process Outsourcing’ Code Main.pptx
Cracking the ‘Business Process Outsourcing’ Code Main.pptx
 
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISING
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISINGUNLEASHING THE POWER OF PROGRAMMATIC ADVERTISING
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISING
 

Hiring the Most Qualified Firefighter While Avoiding Lawsuits

  • 1. Fire & Police Selection, Inc. Hiring the Most Qualified Firefighters…. … While Avoiding (and Defending) Lawsuits
  • 2. Contact Information Dan A. Biddle, Ph.D. Stacy L. Bell, M.S. CEO, Biddle Consulting Group, Inc./Fire & Police Selection, Inc. 193 Blue Ravine, Ste. 270 Folsom, CA 95630 1-888-990-3473 www.biddle.com | www.FPSI.com Email: dan@biddle.com | s [email_address]
  • 3.
  • 4.
  • 5.
  • 6.
  • 7. The Quickly Changing Climate of Personnel Testing…
  • 8.
  • 9. How Can Testing Practices be Challenged? Title VII Disparate Impact Discrimination Flowchart “ OR ” Practice, Procedure, or Test (PPT) Adverse Impact? YES NO Is the PPT Valid? YES NO Alternative Employment Practice? NO Defendant Prevails YES Plaintiff Prevails END Plaintif f Prevails
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19. Firefighter Job Analysis Duties Sample yes yes 4 4.00 8.25 Takes inventory and records and reports equipment and apparatus missing or needing repair or replacement. A3 no yes 4 3.13 8.25 Recognizes the need and makes recommendations for entries in daily log. A2 no yes 5 4.88 8.75 Arrives on time, receives and follows orders, instructions, regarding the work to be done. A1 Assignable Fundamental Best Worker Importance Frequency Domain A Station Duties   Supervisor Ratings Firefighter/EMT-I, Firefighter-PM and Fire Engineer Duties  
  • 20. Firefighter Job Analysis KSAPCs Sample 3 1 HQ 4.13 6.38 A5, A20, C6, F11 Ability to maintain respect for other’s emotional needs following a crisis. O55 4 1 MQ 4.63 7.63 A5, A20, E1, F8, G2 Willing to remain calm under pressure or heavy workloads, not easily given to hostility, anxiousness, or vulnerability. Wiling to make sensible decisions under pressure. O54 4 1 MQ 4.13 7.25 A1, A2, A24, C5 Willing to be resourceful, goal-oriented, and proactive in bringing tasks to completion. O53 Level Needed Upon Entry Best Worker MQ vs. HQ Importance Frequency This KSAPC is linked to the following duties. Domain O Knowledges, Skills, Abilities, and Personal Characteristics (KSAPCs) : The following knowledge skills, abilities, and personal characteristics affect work behavior and are necessary or important for successful job performance.   Supervisor Ratings Firefighter/EMT-I, Firefighter-PM, and Fire Engineer KSAPCs      
  • 21.
  • 22. Selection Plan— Sample *The score from this selection procedure will be combined with scores from other selection procedures in the selection process. P/F MQ 3.1 N/A 3.5 1.4 Basic math skills MQ 3.4 N/A 3.9 1.9 Upper body strength P/F MQ 3.9 3.4 3.5 2.6 Knowledge of Fire Codes R MQ 3.7 N/A 3.5 3.9 Verbal communication skills R MQ 4 N/A 3.2 4.2 Interpersonal and team work skills Background Check Structured Interview Written Test Application Form Minimum/Helpful Qualification (MQ/HQ) Importance (1-5) Level Needed (Knowledges Only) (1-4) Level Needed Upon Entry (1-4) Best Worker (1-5) Knowledge, Skills, Ability, Personal Characteristic, or Physical Requirement Selection Procedure and Use ( P ass/Fail, R ank, or C ombine*) KSAPC/Physical Requirement Rating KSAPC/ Phys Req.
  • 23. Job Duties Operationally defined KSAOs Other KSAOs Selection Devices (e.g., application form, tests, interviews) Content Validity Essential #3: Connecting the Test to the Job Content Valid!
  • 24.
  • 25.
  • 26.
  • 27.
  • 28. Comparison Between “Test Use” Options Low Moderate High # Item Requirements Low Moderate High Reliability Requirements High Moderate Low Development Time High Moderate/Controllable Restrictive/Controllable Applicant Flow High Moderate Low Cost Low Moderate High Utility Low Moderate High Litigation "Red Flag" High High Low Defensibility Low Moderate High Adverse Impact Low Moderate High Validation Requirements Pass/Fail Cutoffs Banding Ranking Factor
  • 29. Weighting/Combining Scores Some thoughts... Job Performance Cognitive Ability Experience/ Background Interpersonal Personality Factors
  • 30. Sample Data—Cognitive and Personality Test Scores Total Scores 156 69 W M 175 70 W F 161 70 B M 158 71 B M M M M Gender W B W Ethnicity 63 68 72 Cognitive Score 156 225 175 Personality Score
  • 31. Sample Data—Cognitive and Personality Test Scores Combined Test Scores M M M M F M M Gender W W B B W B W Ethnicity 63 69 70 71 70 68 72 Cognitive % Score 156 156 161 158 175 225 175 Personality Score 73% 79% 81% 81% 81% 83% 83% Combined % Score
  • 32.
  • 33.
  • 34.
  • 35. U.S. Fire Department Input & Opinions Personal Characteristics 55% Cognitive/Academic Skills & Abilities 45% National Fire Select Test™ Cognitive/Academic Component Strategic Decision- Making 14% Problem Solving 14% Map Reading 10% Writing Ability 15% Reading Ability 18% Mathematical Reasoning 15% Mechanical Ability 14% Personal Characteristics Component Thoroughness/ Attention To Detail 9% Public Relations 9% Sensitivity 8% Emotional Stability 10% Proactive/ Goal-Oriented 8% Truthfulness/ Integrity 13% Allegiance/ Loyalty 10% Working Under Stress 10% Teamwork 12% Following Orders 11%
  • 36. Proposed Solutions for Testing Cognitive/Academic Competencies for Entry-Level Firefighters Notes: CV: Content Validity; CRV: Criterion-related validity. CV/CRV Using CV, measure mechanical comprehension skills such as leverage, force, and mechanical/ physics contexts regarding weights, shapes, and distances. Also can measure spatial reasoning (when using a CRV validation strategy). 12% Mechanical Ability CV While a Structured Interview is the best tool for measuring this skill (because the applicant can be asked to apply this skill in firefighter-specific scenarios), some level of this skill can be measured using word problems or other contexts supplied in written format where applicants can consider cause/effect of certain actions. 13% Strategic Decision-Making CRV Measure using word problems measuring reasoning skills in job-rich contexts. 15% Problem-Solving CV Measure using maps and related questions asking applicants how they would maneuver to certain locations. Include directional awareness. 8% Map Reading CV Measure using writing passages or word recognition lists, sentence clarity, and/or grammar evaluation items. 12% Writing CV While a Structured Interview is the best tool for measuring this skill (because the skill includes verbal and non-verbal aspects), some level of this skill can be measured using word recognition lists or sentence clarity items. 15% Verbal Communication CV Measure using either (1) “Test Preparation Manual” approach (where applicants are given a manual and asked to study it for a few weeks prior to taking the test based on the Manual); or (2) a short reading passage containing material at a similar difficulty/context to the job that applicants are allowed to study during the testing session and answer related test items. 14% Reading CV Use written or “work sample” format; measure using a limited number of multiple-choice items. Balance various types of math skills (add/subtract/multiple, etc.). 10% Math Typical Validation Method Proposed Testing Solution Weight Cognitive/Academic (45% Overall Importance)
  • 37. Proposed Solutions for Personal Characteristics for Entry-Level Firefighters Notes: CV: Content Validity; CRV: Criterion-related validity. 11% Following Orders 9% Thoroughness/Attention to Detail CV/CRV These competencies can be effectively measured using either an SJT (using a CV or CRV strategy) or a Conscientiousness (CS) scale (using a CRV strategy). A CS test can be developed using just 20-30 items (using likert- type responses). Such tests are typically successful in predicting job performance in fire settings. 8% Proactive/Goal-Oriented 8% Sensitivity 10% Emotional Stability 9% Public Relations 13% Truthfulness/Integrity 10% Allegiance/Loyalty 10% Working Under Stress CV/CRV Under a CV strategy, a Situational Judgment Test (SJT) can be used for measuring these skills. Alternatively, a custom personality test can be developed using CRV. while these types of assessments can measure if an applicant knows the most appropriate response (using an SJT) or the best attitude or disposition (personality test), they are limited in that they cannot measure whether an applicant would actually respond in such a way. For these reasons, measuring the underlying traits that tend to generate these positive behaviors is typically the most effective strategy. Structured Interviews can also provide useful insight into these types of competencies, as well as background and reference evaluations. However, these tools are time consuming and expensive, so measuring these areas in the testing stage is an effective strategy. 12% Teamwork Typical Validation Method Proposed Testing Solution Weight Personal Characteristics (55% Overall)
  • 38. Selecting the Ideal Firefighter Critical Skills & Abilities Test “A” Test “B” Reading Ability Mathematical Ability Spatial Abilities Mechanical Aptitudes Writing Ability Interpersonal Skills Decision Making Test “C” Map Reading NFST™
  • 39.
  • 40.
  • 41.

Editor's Notes

  1. All From 14C4 of Guidelines.