I/ITSEC 2022 Advanced Distributive Learning (ADL) Initiative Paper Presentations

Advanced Distributive Learning (ADL) Initiative was invited to present three papers during the 2022 Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC) in the Orange County Convention Center in Orlando, Florida.

• DoD Learning Enclave: Realizing the Defense-wide Learning Ecosystem (Paper 22313) by Sae Schatz, Ph.D., and Brent Smith

• The Impact of the PERvasive Learning System (PERLS) on Stakeholders’ Perceptions and Classroom Retention (Paper 22468) by Scotty Craig, Wendy Barnard, Karen Gordon, Dawn Riddle, and Laura Milham, Ph.D.

• Technology is the Easy Part: Transforming Business Processes for Interoperability (Paper 22202) by Lora Muchmore, Sae Schatz Ph.D., Ashley Howell, Andy Johnson, and Anne Marie DiNardo

Below are summaries of each presentation.

Together with Former ADL Director Dr. Sae Schatz, Mr. Brent Smith (SETA) wrote a paper titled DoD Learning Enclave: Realizing the Defense-wide Learning Ecosystem, which summarized the history, purpose, and progress of implementing a Defense-wide learning ecosystem. During his presentation at I/ITSEC, Mr. Smith provided an overview of the paper, focusing on progress made and lessons learned during the past year.

His presentation began with an introduction to the ADL Initiative, highlighting the recent realignment under Defense Human Resources Activity (DHRA) which reflects the industry trend to integrate learner data within human resources (HR). He then shared the overall vision of the Enterprise Digital Learning Modernization (EDLM) reform which focuses on building a data-centric career-long continuum of learning. A major component of the EDLM program is the “DoD Learning Enclave” (DLE), which is slated to launch on the USAF Platform One in FY23.

The DLE is a secure, cloud-based environment where previously approved EdTech applications and platforms can be deployed quickly and cost-effectively. This work removes barriers and increases access to next-generation tools and technologies that support training and education. The DLE enables shared hosting and IT services for hosting, operating, and maintaining applications for defense-wide use. Mr. Smith focused on the IT/cybersecurity aspect of the shared service and described Executive Order 14028 (Improving the Nation’s Cybersecurity) as a guide for discussing the technical and non-technical components and processes that must be addressed to modernize software delivery.

A critical aspect of this work is the layered defense and continuous monitoring capabilities facilitated by Platform One, a modern DevSecOps platform that provides Continuous Integration / Continuous Delivery (CI/CD) pipelines for all DLE applications. After deep-diving into the technical details of the DLE, Mr. Smith concluded with an overview of lessons learned during the process:

• Harden containers in Iron Bank before building your pipelines

• Expedite software development by designing around available Iron Bank containers

• Adhere to DevSecOps across technology readiness levels

• Small steps empower progress

• Rethink and relearn often / continuous process improvement

Mr. Smith ended his presentation by encouraging the audience to explore the list of resources provided and to read the paper.

Next, Dr. Milham, Director of the ADL Initiative, presented The Impact of the PERvasive Learning System (PERLS) on Stakeholders’ Perceptions and Classroom Retention. The overarching goal of this paper was to investigate the effectiveness of the PERvasive Learning System (PERLS) which included analyzing student and instructor perceptions and evaluating the potential of data generated by PERLS in conformance with the ADL’s Total Learning Architecture (TLA).

Dr. Milham began her presentation by providing insights into the mobile capability of PERLS and how it was used in conjunction with Microlearning (using small learning units and short-term focused activities) and Self-Regulated Training (decomposes learning processes into recursive phrases that are enacted strategically and intentionally).

She then shared details of the methodology used to drive the study, which included 425 participants recruited from a pool of soldiers taking classes at The Sabalauski Air Assault School (TSAAS) in Fort Campbell, Kentucky. Three specific research questions were addressed during the study:

1. Were students and instructors able to use PERLS successfully within a course?

2. Were instructors able to perceive a difference from the use of PERLS compared to traditional instruction?

3. Was there evidence of impact on course completion rates?

Study participants were placed into two groups – a control and a PERLS focus group. Soldiers in the Control group received their TSAAS course as normal, while soldiers assigned to the PERLS focus group had access to the PERLS system in addition to receiving their standard TSAAS course. Various content interfaces were delivered to students, including articles, interaction cards (flash and quiz cards), and tip cards to augment and expand on the TSAAS course using different content modalities and experiencing the Self-Regulated Learning (SRL) aspects of PERLS.

The study found that instructors perceived PERLS as helpful, and soldiers would recommend it. Results also showed that soldiers that interacted with PERLS had a 24% higher completion rate than those that did not interact with PERLS.

Overall, the evaluation found that PERL’s effectiveness was very positive and that it would be very well-adapted and well-suited for being integrated into military education and training. Read the paper.

To conclude the ADL presentations, Andy Johnson and Ashley Howell co-presented the paper Technology is the Easy Part: Transforming Business Processes for Interoperability. To begin, the team shared the progression of the ADL Initiative from its inception in 1999, focusing on how priority shifted from policy and documentation management to overseeing coordination as part of the Enterprise Digital Learning Modernization (EDLM) effort.

The EDLM program establishes a learning ecosystem through the development of an assisted acquisition pipeline and a cloud-based environment for procuring, implementing, hosting, and sustaining shared education and training services. The technology application is only one aspect and the easiest part, attaining enterprise-wide interoperability is required to fully realize a modern learning ecosystem. As suggested by the title of the paper, this is the most challenging and highly complex task to implement as it involves a transformation in business processes which includes planning, coordination, policy, diplomacy, and standards.

To understand these barriers further, the team held an EDLM business process reengineering workshop. With over 135 attendees, the workshop consisted of three major activities: theory of change, pain point case studies, and force field analysis. The theory of change exercise gave the team insights into how human behavior works, whether that be from a cultural or personal standpoint. Known issues and desired states were shared during the pain point case studies and the force field analysis helped the team understand the driving or positive forces and the restraining or negative forces for EDLM interoperability. This defined process informed eight categories of problem states, and the presenters shared each with a corresponding recommendation. These include:

1. Establish an Interoperability Maturity Accreditation Process to Achieve DoD-wide Interoperability Compliance

2. Implement a Common Cloud Environment for Testing Interoperability of Software Capabilities

3. Instrument Performance Data Standards into Learning Capabilities

4. Develop a DoD-wide Course Catalog Capability

5. Develop a DoD Competency-Based Learning Implementation Strategy

6. Develop a DoD-wide Competency Registry

7. Develop Support Resources for Distributed Learning Standards Adoption Solutions

8. Create an Enterprise-wide Distributed Learning Framework

In conclusion, the presenters encouraged everyone to continue to share their own challenges as the ADL Initiative team continues to actively work on updates to help alleviate known burdens. Read the paper.

---

Citation

Schatz, S., Smith, B. (2022). DoD Learning Enclave: Realizing the Defense-wide Learning Ecosystem [Paper presentation]. In Volume 2022 (Eds.), Proceedings of the 2022 Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC). Orlando, FL: National Training and Simulation Association.

Craig, S., Barnard. W., Gordon, K., Riddle, D., Milham, L. (2022) The Impact of the PERvasive Learning System (PERLS) on Stakeholders’ Perceptions and Classroom Retention [Paper presentation]. In Volume 2022 (Eds.), Proceedings of the 2022 Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC). Orlando, FL: National Training and Simulation Association.

Howell, A., Johnson, A., Dinardo, A. M., Schatz, S., Muchmore, L. (2022). Technology is the Easy Part: Transforming Business Processes for Interoperability [Paper presentation]. In Volume 2022 (Eds.), Proceedings of the 2022 Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC). Orlando, FL: National Training and Simulation Association.