Completed
The Intelligence Community Studies Board of the National Academies of Sciences, Engineering, and Medicine convened a workshop on August 9-10, 2017 to examine challenges in machine generation of analytic products from multi-source data. Workshop speakers and participants discussed research challenges related to machine-based methods for generating analytic products and for automating the evaluation of these products, with special attention to learning from small data, using multi-source data, adversarial learning, and understanding the human-machine relationship.
Featured publication
Workshop
·2017
The Intelligence Community Studies Board of the National Academies of Sciences, Engineering, and Medicine convened a workshop on August 9-10, 2017 to examine challenges in machine generation of analytic products from multi-source data. Workshop speakers and participants discussed research challenges...
View details
Description
Theobjectiveofthiseffortistoprovideinsightsfromworld-classexpertsandtechnologistsfamiliarwiththeextensiverangeofissuesassociatedwiththeapplicationofartificialintelligenceto the Intelligence Community (IC)analytictradecraft.Existingandemergingcapabilities,technicalimplications,cultural,regulatory,policy,andlegalissuesareallofinterest. Thiseffortwillrequirearrangingandrunningatwo-dayworkshop involvingawiderangeoftechnicaldisciplinesinindustry,academia,andgovernmenttoinvestigateissuesaroundtheapplicationofartificialintelligencetechniquestoICanalytictradecraft.This unclassifiedworkshopwilladdressthefollowingresearchchallenges:
1) Machine-basedmethodsforgeneratinganalyticproducts, and 2) Machine-basedmethods forautomatingtheevaluationofanalyticproducts. The workshop will explorethestate-of-the-artandsecurityimplicationsofexistingandemergingtechnologiespertinenttothese topics.A workshop proceedings will be delivered after the workshop. Thefollowingtasksareanticipated:
Task1:Forman ad hoc planning committeeofexpertstobeapprovedbytheleadershipoftheNationalAcademies.The committee will includeworld-classexpertsandtechnologistsfamiliarwiththebroadrangeofissuesgermanetotheapplicationofartificialintelligencetechniquestoICanalytictradecraft.Whendevelopingtheagendafortheworkshop, the committee will considerthefollowingresearchquestions:
• Whatarethetechnicalobjectivesandmetrics neededforsuccess?
• Whataretheprimaryissues?
• Whatarethecurrentand"nextlevel"keyperformancemetrics? Whatisthe"level afternext"ofexpectedresearchanddevelopmentperformance?
• Whatistheresearchknowledgebase?
• Howcanthe governmentbestpreparethescientificworkforcetoenhancediscoveryinthis area?
Task2:Arrangeandexecutea workshopofatleasttwodays duration.Thisincludessecuringavenue, organizing and managingtheworkshop,andprovidingadequate facilitatorsandnotetakerstoensurethatpreparedmaterialsandinsightsfromtheworkshoparesaved.
Task3:Prepareaworkshopproceedings,includingpresenters'materials,that recordstheexperts'keyarguments,information,andinsightspresentedduringthecourseoftheworkshop.Thefinal reviewed draft proceedings will undergo sponsor securityreviewbeforepostingorotherwisepublishinginwholeorinpart.
Contributors
Sponsors
Other, Federal
Staff
George Coyle
Lead