Skip to main content

Intelligence Machine Analytics Workshop

Completed

The Intelligence Community Studies Board of the National Academies of Sciences, Engineering, and Medicine convened a workshop on August 9-10, 2017 to examine challenges in machine generation of analytic products from multi-source data. Workshop speakers and participants discussed research challenges related to machine-based methods for generating analytic products and for automating the evaluation of these products, with special attention to learning from small data, using multi-source data, adversarial learning, and understanding the human-machine relationship.

Description

Theobjectiveofthiseffortistoprovideinsightsfromworld-classexpertsandtechnologistsfamiliarwiththeextensiverangeofissuesassociatedwiththeapplicationofartificialintelligenceto the Intelligence Community (IC)analytictradecraft.Existingandemergingcapabilities,technicalimplications,cultural,regulatory,policy,andlegalissuesareallofinterest. Thiseffortwillrequirearrangingandrunningatwo-dayworkshop involvingawiderangeoftechnicaldisciplinesinindustry,academia,andgovernmenttoinvestigateissuesaroundtheapplicationofartificialintelligencetechniquestoICanalytictradecraft.This unclassifiedworkshopwilladdressthefollowingresearchchallenges:

1) Machine-basedmethodsforgeneratinganalyticproducts, and 2) Machine-basedmethods forautomatingtheevaluationofanalyticproducts. The workshop will explorethestate-of-the-artandsecurityimplicationsofexistingandemergingtechnologiespertinenttothese topics.A workshop proceedings will be delivered after the workshop. Thefollowingtasksareanticipated:

Task1:Forman ad hoc planning committeeofexpertstobeapprovedbytheleadershipoftheNationalAcademies.The committee will includeworld-classexpertsandtechnologistsfamiliarwiththebroadrangeofissuesgermanetotheapplicationofartificialintelligencetechniquestoICanalytictradecraft.Whendevelopingtheagendafortheworkshop, the committee will considerthefollowingresearchquestions:

Whatarethetechnicalobjectivesandmetrics neededforsuccess?

Whataretheprimaryissues?

Whatarethecurrentand"nextlevel"keyperformancemetrics? Whatisthe"level afternext"ofexpectedresearchanddevelopmentperformance?

Whatistheresearchknowledgebase?

Howcanthe governmentbestpreparethescientificworkforcetoenhancediscoveryinthis area?


Task2:Arrangeandexecutea workshopofatleasttwodays duration.Thisincludessecuringavenue, organizing and managingtheworkshop,andprovidingadequate facilitatorsandnotetakerstoensurethatpreparedmaterialsandinsightsfromtheworkshoparesaved
.

Task3:Prepareaworkshopproceedings,includingpresenters'materials,that recordstheexperts'keyarguments,information,andinsightspresentedduringthecourseoftheworkshop.Thefinal reviewed draft proceedings will undergo sponsor securityreviewbeforepostingorotherwisepublishinginwholeorinpart.

Subscribe to Email from the National Academies
Keep up with all of the activities, publications, and events by subscribing to free updates by email.