Notes
Slide Show
Outline
1
Managing the Development of Technology-Based Courses:
Success Factors
from
Eight Government Training Courses

Presented to the Distance Teaching and Learning Conference
16 August 2002
2
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses


    • John Bennett, M.S. Retired Navy Pilot and DoD Program Manager
    • Kurt Rowley, PhD,Instructional Systems Research & Development, Inc. (ISRD)
    • Ellen Bunker, PhD, ISRD

3
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses

    • DAU and Student Information


    • Research Project Basis and Design


    • Data Collection/Analysis


    • Results


    • Discussion and Conclusions


4
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • DAU consists of five campuses across the United States


    • Capital/Northeast
    • Mid-Atlantic
    • Midwest
    • South
    • West
5
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • DAU faculty:
    • Are both military and civilian with backgrounds as practitioners of Acquisition Management
    • Develop and Teach Acquisition Workforce training courses
    • Provide Performance Support, Knowledge Management and Continuous Learning resources
    • Conduct research
6
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • Student characteristics
    • Professional DoD employees
    • Variety of backgrounds & experience levels
    • Drawn from all four services and DOD agencies
    • Both military and civilian
    • Continuous supply
      • Certification courses required for career advancement
    • No out-of-pocket costs for students
7
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • Corporate University Model
    • Provide more services on-demand
    • Shift away from traditional classroom teaching
      • Flexibility for students
      • Instructional opportunities
      • Cost savings
      • Increased throughput
8
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • Context of the Research
    • Course development manager responsibilities
    • Dynamically changing management and technical environment
    • Course selection criteria
9
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • Definition of Technology-Based Courses
  • Audience poll
  • What three factors were most important to the successful development of our tech-based courses?
      • Effectively Blending Delivery Modes/Technologies
      • Technical Configuration Control
      • Project Planning/Management Techniques







10
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • Literature review
    • Large body of knowledge available
  • Qualitative design
    • Guided interviews
    • Qualitative data analysis
    • Post-hoc analysis and review of findings



11
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • Face-to-face guided interviews
  • Transcript analysis identified 99 issues
    • Issues were organized into main theme categories
    • Ten most commonly recurring issues identified as success factors
    • Post-hoc analysis reviewed by course managers
    • Ten initial factors reduced to eight
      • Factors #3 and #7 combined
      • Factors #8 and #10 combined
12
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • Eight success factors were identified
    • 1.  Effectively Blending Technologies
      • Analysis of available delivery technologies
      • Blending technologies to optimize learning
    • 2.  Technical configuration control
      • Maintaining version control over updated content
      • Maintaining version control over course releases
      • Controlling and tracking learning objectives across content and exams





13
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • Identified success factors (continued)


    • 3. Project Planning and Management Techniques
      • Defining requirements and developing effective baselines
      • Making appropriate management tradeoffs
    • 4. (tie) Meeting student needs with sound instructional design strategies
      • Particularly important for online interactions
      • Consider difficulty level, student preparedness, and providing students an effective learning environment
14
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • Identified success factors (continued)


    • 4. (tie) Subject Matter Expert Availability
      • Timely access to subject matter experts


    • 4. (tie) Effective Test and Evaluation
      • Early usability testing of prototypes
      • Iterative formative testing
      • Pilot offerings to both faculty and students



15
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • Identified success factors (continued)


    • 5. Staffing and teaming
      • Proper skill mix
      • Integrated team
      • Effective, well-understood team processes


    • 6. Long-term technology support
      • Consideration of future technology requirements
      • Compatibility with future software versions



16
 
17
Managing the Development of Technology-Based Courses:
Success Factors From Eight Government Training Courses
  • Relationship of DAU success factors to literature
    • Both addressed human factors and technology
    • DAU addressed more Project Management issues
  • Research provided a reasonable group of success factors
  • Further research warranted
    • Understand mechanisms for their application in future course developments
  • Take-Away
    • Effectively integrate Technical, Design and Managerial skills in a team environment for optimal results