Internet of Things Devices

Transkrypt

1 Internet of Things Devices } Internet of Things (IoT) devices } Have access to an abundance of raw data } In home, work, or vehicle

2 IoT: Raw Data & Processing } IoT is gaining ground with the widespread of } Embedded processors } Ubiquitous wireless networks } Access to raw data } Understand it! } Real-time constraints } Limited resources } Power } Compute

3 IoT: DNN-based Processing } With deep neural networks (DNNs): }With DNNs IoTs can } Process several new data types and } Understand behaviors }Speech, vision, video, and text } But, DNNs are resource hungry }Cannot met real-time constraints on IoT devices }Several DNNs cannot be executed on IoTs

4 Approach 1: Offload to Cloud } Send the request to cloud services } AWS } Google Cloud } Microsoft

5 Why Cloud is not Always a Solution }Unreliable connections to the cloud }Plus low bandwidth and high latency }Disconnected Devices }Privacy }Privacy preserving learning (eg, differential privacy) }Privacy preserving inference (eg homomorphic encryption) }Personalization } Federated learning

6 Approach : IoT Collaboration erver } Distribute computations with collaboration Home Home Network } To meetsdemandsnetwork of DNNs } On top of common DNN User techniques for constrained Secure Domain devices (eg, pruning) (b) In-Home Server Home Alerts User Secure Domain (c) Musical Chair?! Balloon S Computation Domain (a) Single Robot Computation Domain (b) Collaborative Robots

7 IoT Collaboration Pros & Cons } Assuming DNN performance barrier is solved with collaboration among IoT devices Pros Not Dependent on Cloud Privacy Preserving Enables Personalized Insight Cons Unreliable Latencies Accuracy Drop due to Data Loss & Device Failure

8 Challenges Impact: Unreliable Latencies } Histogram of arrival times in -node system performing AlexNet (model parallelism) Compute Time Tail Latency Latency Data Points 0ms Computation <100ms % <10ms % } Long Tail and Max Latency -> Straggler Problem

9 Challenges Impact: Accuracy Drop } Common to loose data parts due to Accuracy (top-1) Accuracy (top-1) Increasing loss Increasing loss Percentage of Data Loss (only in one layer) (a) 10-class digit recognition (LeNet-) Percentage of Data Loss (only in one layer) (b) 1000-class image recognition (Inception v) } High Accuracy Drop Accuracy Drop

10 K sha1_base="i0jzreoqzlhpokx8gyh90e=">aaabhicbzbns8naeiyn9avwrphltf8fqsefry9cjacf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctksapowgncarnmev1oaotaebgjp8apvzqpzrwhvwgppphmmfoz8/ogemzw==</latexit> sha1_base="i0jzreoqzlhpokx8gyh90e=">aaabhicbzbns8naeiyn9avwrphltf8fqsefry9cjacf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctksapowgncarnmev1oaotaebgjp8apvzqpzrwhvwgppphmmfoz8/ogemzw==</latexit> sha1_base="i0jzreoqzlhpokx8gyh90e=">aaabhicbzbns8naeiyn9avwrphltf8fqsefry9cjacf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctksapowgncarnmev1oaotaebgjp8apvzqpzrwhvwgppphmmfoz8/ogemzw==</latexit> sha1_base="i0jzreoqzlhpokx8gyh90e=">aaabhicbzbns8naeiyn9avwrphltf8fqsefry9cjacf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctksapowgncarnmev1oaotaebgjp8apvzqpzrwhvwgppphmmfoz8/ogemzw==</latexit> sha1_base="zopzktcmbjykx/jrhmxlodxcuo=">aaabicbzdlsgmxfibp1futtpln8eiucozrajlykfcvraxamesstntajizkoxqhrcgxekupwfpkztpzaospgy//nepo+yoym1c99spbgxube8ud0t+wehr+xjkoekvom0q8ur0aa8qzpgddke9wfesakwbsz1btpvgkwyqczikv8fiykbfsmuvsdyclitu1v0iryoxqwvytyblr8eoiomg0hcotebmz8fcvdckfz0idrnmzkise0b1fiqbwflnadowvrjfaykfukqqv90skhdyzedhogc1er9yy89apzhhtz8ygsegsrl8kewmhhkdkcjpigxfgybe8xsrohmsmlehhkngrv9er1nsqnuxq0rjjo+jcgdwdpfgqr0acactaaobctzdkwwnlxppzwvbywdoy+czx9kz</latexit> sha1_base="zopzktcmbjykx/jrhmxlodxcuo=">aaabicbzdlsgmxfibp1futtpln8eiucozrajlykfcvraxamesstntajizkoxqhrcgxekupwfpkztpzaospgy//nepo+yoym1c99spbgxube8ud0t+wehr+xjkoekvom0q8ur0aa8qzpgddke9wfesakwbsz1btpvgkwyqczikv8fiykbfsmuvsdyclitu1v0iryoxqwvytyblr8eoiomg0hcotebmz8fcvdckfz0idrnmzkise0b1fiqbwflnadowvrjfaykfukqqv90skhdyzedhogc1er9yy89apzhhtz8ygsegsrl8kewmhhkdkcjpigxfgybe8xsrohmsmlehhkngrv9er1nsqnuxq0rjjo+jcgdwdpfgqr0acactaaobctzdkwwnlxppzwvbywdoy+czx9kz</latexit> sha1_base="zopzktcmbjykx/jrhmxlodxcuo=">aaabicbzdlsgmxfibp1futtpln8eiucozrajlykfcvraxamesstntajizkoxqhrcgxekupwfpkztpzaospgy//nepo+yoym1c99spbgxube8ud0t+wehr+xjkoekvom0q8ur0aa8qzpgddke9wfesakwbsz1btpvgkwyqczikv8fiykbfsmuvsdyclitu1v0iryoxqwvytyblr8eoiomg0hcotebmz8fcvdckfz0idrnmzkise0b1fiqbwflnadowvrjfaykfukqqv90skhdyzedhogc1er9yy89apzhhtz8ygsegsrl8kewmhhkdkcjpigxfgybe8xsrohmsmlehhkngrv9er1nsqnuxq0rjjo+jcgdwdpfgqr0acactaaobctzdkwwnlxppzwvbywdoy+czx9kz</latexit> sha1_base="zopzktcmbjykx/jrhmxlodxcuo=">aaabicbzdlsgmxfibp1futtpln8eiucozrajlykfcvraxamesstntajizkoxqhrcgxekupwfpkztpzaospgy//nepo+yoym1c99spbgxube8ud0t+wehr+xjkoekvom0q8ur0aa8qzpgddke9wfesakwbsz1btpvgkwyqczikv8fiykbfsmuvsdyclitu1v0iryoxqwvytyblr8eoiomg0hcotebmz8fcvdckfz0idrnmzkise0b1fiqbwflnadowvrjfaykfukqqv90skhdyzedhogc1er9yy89apzhhtz8ygsegsrl8kewmhhkdkcjpigxfgybe8xsrohmsmlehhkngrv9er1nsqnuxq0rjjo+jcgdwdpfgqr0acactaaobctzdkwwnlxppzwvbywdoy+czx9kz</latexit> sha1_base="znmeehlschnatwukr8yb9rnlbq=">aaabxicbzbns8naeiynftbvfxozbeinkoighlxjxwsb/qhrlzbnq1mzynrrkh/wkerr/fb/bt0ovrcwsmm+zmgrsghtdbdtfwnzau0u9dz8rbwdtzknonnpqtsnyaalkxcmyhq8kqoy0dydvbgwb+nkiljzhjur/tqsiiwshaq9ubhwpnv1j1a+czbw8aqpqqngvfpvcxbkyj8gknabrusnoduomottci8zpkvsrae8azghmtd+pt9sstejiafssjhp90roymmcwaypds1ybmf/vuhlgnukjrdnrdfr1emcsoyoeqnogcmkbmisroqnqaymbublgkfpiqtcrnuwhqr9toijbkdwbhfgwtxura0aqgt/amr/dmkoffexc+fq1rtjfzan/kfpaygpqg==</latexit> sha1_base="znmeehlschnatwukr8yb9rnlbq=">aaabxicbzbns8naeiynftbvfxozbeinkoighlxjxwsb/qhrlzbnq1mzynrrkh/wkerr/fb/bt0ovrcwsmm+zmgrsghtdbdtfwnzau0u9dz8rbwdtzknonnpqtsnyaalkxcmyhq8kqoy0dydvbgwb+nkiljzhjur/tqsiiwshaq9ubhwpnv1j1a+czbw8aqpqqngvfpvcxbkyj8gknabrusnoduomottci8zpkvsrae8azghmtd+pt9sstejiafssjhp90roymmcwaypds1ybmf/vuhlgnukjrdnrdfr1emcsoyoeqnogcmkbmisroqnqaymbublgkfpiqtcrnuwhqr9toijbkdwbhfgwtxura0aqgt/amr/dmkoffexc+fq1rtjfzan/kfpaygpqg==</latexit> sha1_base="znmeehlschnatwukr8yb9rnlbq=">aaabxicbzbns8naeiynftbvfxozbeinkoighlxjxwsb/qhrlzbnq1mzynrrkh/wkerr/fb/bt0ovrcwsmm+zmgrsghtdbdtfwnzau0u9dz8rbwdtzknonnpqtsnyaalkxcmyhq8kqoy0dydvbgwb+nkiljzhjur/tqsiiwshaq9ubhwpnv1j1a+czbw8aqpqqngvfpvcxbkyj8gknabrusnoduomottci8zpkvsrae8azghmtd+pt9sstejiafssjhp90roymmcwaypds1ybmf/vuhlgnukjrdnrdfr1emcsoyoeqnogcmkbmisroqnqaymbublgkfpiqtcrnuwhqr9toijbkdwbhfgwtxura0aqgt/amr/dmkoffexc+fq1rtjfzan/kfpaygpqg==</latexit> sha1_base="znmeehlschnatwukr8yb9rnlbq=">aaabxicbzbns8naeiynftbvfxozbeinkoighlxjxwsb/qhrlzbnq1mzynrrkh/wkerr/fb/bt0ovrcwsmm+zmgrsghtdbdtfwnzau0u9dz8rbwdtzknonnpqtsnyaalkxcmyhq8kqoy0dydvbgwb+nkiljzhjur/tqsiiwshaq9ubhwpnv1j1a+czbw8aqpqqngvfpvcxbkyj8gknabrusnoduomottci8zpkvsrae8azghmtd+pt9sstejiafssjhp90roymmcwaypds1ybmf/vuhlgnukjrdnrdfr1emcsoyoeqnogcmkbmisroqnqaymbublgkfpiqtcrnuwhqr9toijbkdwbhfgwtxura0aqgt/amr/dmkoffexc+fq1rtjfzan/kfpaygpqg==</latexit> sha1_base="nqekat9otgnhoykskd9yfhsg+ug=">aaabhicbzbns8naeiyn9avwrphltfea8leugprs8ewaf0iayuatztnn0ijfqxepggifd/kjf/jdsb19yehhnrlg0swbvxw+nsla+sblvctothqpj1othxdjotfrdob1sixkbhrmanuuijqgagn/nu0nvjrh8sfmevqjopq8iwaazuu+uwkwxniqvgvcbxpv++asifkaotrmuknpsyppkcczwwuqlghpkxnsixyusrqj9bloljxzz0dcwnkndzmvycygmk9iqlbgvez0su1mflfrzua8mbpuexsgitpgptquxmzletavfijjhyoexxuythioomzabkgbwzfvqxvc9ypsu8jkmijnmiehannbihojsbacizvmkb8+i8oo/oxk1oqzx/bhzucpcaomrg==</latexit> sha1_base="nqekat9otgnhoykskd9yfhsg+ug=">aaabhicbzbns8naeiyn9avwrphltfea8leugprs8ewaf0iayuatztnn0ijfqxepggifd/kjf/jdsb19yehhnrlg0swbvxw+nsla+sblvctothqpj1othxdjotfrdob1sixkbhrmanuuijqgagn/nu0nvjrh8sfmevqjopq8iwaazuu+uwkwxniqvgvcbxpv++asifkaotrmuknpsyppkcczwwuqlghpkxnsixyusrqj9bloljxzz0dcwnkndzmvycygmk9iqlbgvez0su1mflfrzua8mbpuexsgitpgptquxmzletavfijjhyoexxuythioomzabkgbwzfvqxvc9ypsu8jkmijnmiehannbihojsbacizvmkb8+i8oo/oxk1oqzx/bhzucpcaomrg==</latexit> sha1_base="nqekat9otgnhoykskd9yfhsg+ug=">aaabhicbzbns8naeiyn9avwrphltfea8leugprs8ewaf0iayuatztnn0ijfqxepggifd/kjf/jdsb19yehhnrlg0swbvxw+nsla+sblvctothqpj1othxdjotfrdob1sixkbhrmanuuijqgagn/nu0nvjrh8sfmevqjopq8iwaazuu+uwkwxniqvgvcbxpv++asifkaotrmuknpsyppkcczwwuqlghpkxnsixyusrqj9bloljxzz0dcwnkndzmvycygmk9iqlbgvez0su1mflfrzua8mbpuexsgitpgptquxmzletavfijjhyoexxuythioomzabkgbwzfvqxvc9ypsu8jkmijnmiehannbihojsbacizvmkb8+i8oo/oxk1oqzx/bhzucpcaomrg==</latexit> sha1_base="nqekat9otgnhoykskd9yfhsg+ug=">aaabhicbzbns8naeiyn9avwrphltfea8leugprs8ewaf0iayuatztnn0ijfqxepggifd/kjf/jdsb19yehhnrlg0swbvxw+nsla+sblvctothqpj1othxdjotfrdob1sixkbhrmanuuijqgagn/nu0nvjrh8sfmevqjopq8iwaazuu+uwkwxniqvgvcbxpv++asifkaotrmuknpsyppkcczwwuqlghpkxnsixyusrqj9bloljxzz0dcwnkndzmvycygmk9iqlbgvez0su1mflfrzua8mbpuexsgitpgptquxmzletavfijjhyoexxuythioomzabkgbwzfvqxvc9ypsu8jkmijnmiehannbihojsbacizvmkb8+i8oo/oxk1oqzx/bhzucpcaomrg==</latexit> sha1_base="npptxwrvkpxqvmhodwztgu=">aaacnhicbzdlsgmxfiyz9vbrbdslmarxjwziuhgkbak0ouvaxaomtstanxejoigwyhljggrwyuibn0g0tqww8e/nx/difnd0pbfvjwqfawlzxuuvzzytzzn9mgoisvmvbikqdzcojrjpqsbbseyogffcweruodjy/dmkhtzamwdsjpz9oswgkwoww8aeikntjzaleaeu/jyll9mfi8t/0ri/xluen+nrjypemfmwjlrxhhrforrdoqoozzqxpqygm+ueguatpwcoysobuscttihqlcrqhmtqrm9qbpl0wksydakpjgmztiimn1nbz9uupqf/neypn9emohvwjrkfrsb8ohnujqsgai8sxb0ugqux1ijqyfvfme0tssjondmbht+uvry+dsrw9osowlarxpdiao0tgy0skqobkqocqibg9ohf0ytwzb8an8tvmjkmpfvotxnfp/1pqlo=</latexit> sha1_base="npptxwrvkpxqvmhodwztgu=">aaacnhicbzdlsgmxfiyz9vbrbdslmarxjwziuhgkbak0ouvaxaomtstanxejoigwyhljggrwyuibn0g0tqww8e/nx/difnd0pbfvjwqfawlzxuuvzzytzzn9mgoisvmvbikqdzcojrjpqsbbseyogffcweruodjy/dmkhtzamwdsjpz9oswgkwoww8aeikntjzaleaeu/jyll9mfi8t/0ri/xluen+nrjypemfmwjlrxhhrforrdoqoozzqxpqygm+ueguatpwcoysobuscttihqlcrqhmtqrm9qbpl0wksydakpjgmztiimn1nbz9uupqf/neypn9emohvwjrkfrsb8ohnujqsgai8sxb0ugqux1ijqyfvfme0tssjondmbht+uvry+dsrw9osowlarxpdiao0tgy0skqobkqocqibg9ohf0ytwzb8an8tvmjkmpfvotxnfp/1pqlo=</latexit> sha1_base="npptxwrvkpxqvmhodwztgu=">aaacnhicbzdlsgmxfiyz9vbrbdslmarxjwziuhgkbak0ouvaxaomtstanxejoigwyhljggrwyuibn0g0tqww8e/nx/difnd0pbfvjwqfawlzxuuvzzytzzn9mgoisvmvbikqdzcojrjpqsbbseyogffcweruodjy/dmkhtzamwdsjpz9oswgkwoww8aeikntjzaleaeu/jyll9mfi8t/0ri/xluen+nrjypemfmwjlrxhhrforrdoqoozzqxpqygm+ueguatpwcoysobuscttihqlcrqhmtqrm9qbpl0wksydakpjgmztiimn1nbz9uupqf/neypn9emohvwjrkfrsb8ohnujqsgai8sxb0ugqux1ijqyfvfme0tssjondmbht+uvry+dsrw9osowlarxpdiao0tgy0skqobkqocqibg9ohf0ytwzb8an8tvmjkmpfvotxnfp/1pqlo=</latexit> sha1_base="npptxwrvkpxqvmhodwztgu=">aaacnhicbzdlsgmxfiyz9vbrbdslmarxjwziuhgkbak0ouvaxaomtstanxejoigwyhljggrwyuibn0g0tqww8e/nx/difnd0pbfvjwqfawlzxuuvzzytzzn9mgoisvmvbikqdzcojrjpqsbbseyogffcweruodjy/dmkhtzamwdsjpz9oswgkwoww8aeikntjzaleaeu/jyll9mfi8t/0ri/xluen+nrjypemfmwjlrxhhrforrdoqoozzqxpqygm+ueguatpwcoysobuscttihqlcrqhmtqrm9qbpl0wksydakpjgmztiimn1nbz9uupqf/neypn9emohvwjrkfrsb8ohnujqsgai8sxb0ugqux1ijqyfvfme0tssjondmbht+uvry+dsrw9osowlarxpdiao0tgy0skqobkqocqibg9ohf0ytwzb8an8tvmjkmpfvotxnfp/1pqlo=</latexit> sha1_base="9ij/nmfdhhuntmscpsybs8/w=">aaab8xicbzdlsgmxfibp1futtpln8eiucozvdbl0ylcvacvgyaaynzsrdklhkmg/hxouibn0bdnatslbf0h8pgfc8gfxbzporfjufldw19yizmlredrx/0niyuyqiersdqkskwecng0znhzirxeucnooxtftevurkskudotmporhgowmokntefhtja1k/pvkxfrrhvdya0dfofcjvje/egnjkogkqzjwuuusfftrawjngalxqjpjmkydnxosar1xzhdj9yzofaq+rbm/friojrsdrydsjbezsty1/t1exne+iktcwkoipopwoqji9h0fdrgihldjxywuczuisgik0ymdalkq/awt1gvqqwb9r9sv8jikcathcaoexeadbqabtsagblecrzovznzmwwtopnmif+r8/ga0lzcy</latexit> sha1_base="9ij/nmfdhhuntmscpsybs8/w=">aaab8xicbzdlsgmxfibp1futtpln8eiucozvdbl0ylcvacvgyaaynzsrdklhkmg/hxouibn0bdnatslbf0h8pgfc8gfxbzporfjufldw19yizmlredrx/0niyuyqiersdqkskwecng0znhzirxeucnooxtftevurkskudotmporhgowmokntefhtja1k/pvkxfrrhvdya0dfofcjvje/egnjkogkqzjwuuusfftrawjngalxqjpjmkydnxosar1xzhdj9yzofaq+rbm/friojrsdrydsjbezsty1/t1exne+iktcwkoipopwoqji9h0fdrgihldjxywuczuisgik0ymdalkq/awt1gvqqwb9r9sv8jikcathcaoexeadbqabtsagblecrzovznzmwwtopnmif+r8/ga0lzcy</latexit> sha1_base="9ij/nmfdhhuntmscpsybs8/w=">aaab8xicbzdlsgmxfibp1futtpln8eiucozvdbl0ylcvacvgyaaynzsrdklhkmg/hxouibn0bdnatslbf0h8pgfc8gfxbzporfjufldw19yizmlredrx/0niyuyqiersdqkskwecng0znhzirxeucnooxtftevurkskudotmporhgowmokntefhtja1k/pvkxfrrhvdya0dfofcjvje/egnjkogkqzjwuuusfftrawjngalxqjpjmkydnxosar1xzhdj9yzofaq+rbm/friojrsdrydsjbezsty1/t1exne+iktcwkoipopwoqji9h0fdrgihldjxywuczuisgik0ymdalkq/awt1gvqqwb9r9sv8jikcathcaoexeadbqabtsagblecrzovznzmwwtopnmif+r8/ga0lzcy</latexit> sha1_base="thmd1zfgltdt/dxtpehmi/io8=">aaab8xicbzdlsgmxfibpek1vnxpjlgevwmfnrzdooygr1gozmmmldm8mqzjqyzfucagiw9/gnw9jscw8ifpznhhloh8scaeo8ktrxmzhqi9suxzobgmzkekbrhkpoghwldnbmyztjuxojgkog0h+tpvf1ilwzsjljtp0idwulgchgwvdpd+l1k+rtaxfkrsvdya0dfozcjvje+egnjkogkqzjwuuusfftrawjngbfxqjpjmkydnxosar1xzhdp9yzofaq+rbm/friojrsdrydsjbezsty1/t1exne+iktcwkoipopwoqji9h0fdrgihldjxywuczuisgik0ymdaloq/awt1gvrxiwbtletxerwfoiytoamplqaon9cajhaq8ayv8ozo8vdzmrstopnmef+r8/gakjcb</latexit> sha1_base="thmd1zfgltdt/dxtpehmi/io8=">aaab8xicbzdlsgmxfibpek1vnxpjlgevwmfnrzdooygr1gozmmmldm8mqzjqyzfucagiw9/gnw9jscw8ifpznhhloh8scaeo8ktrxmzhqi9suxzobgmzkekbrhkpoghwldnbmyztjuxojgkog0h+tpvf1ilwzsjljtp0idwulgchgwvdpd+l1k+rtaxfkrsvdya0dfozcjvje+egnjkogkqzjwuuusfftrawjngbfxqjpjmkydnxosar1xzhdp9yzofaq+rbm/friojrsdrydsjbezsty1/t1exne+iktcwkoipopwoqji9h0fdrgihldjxywuczuisgik0ymdaloq/awt1gvrxiwbtletxerwfoiytoamplqaon9cajhaq8ayv8ozo8vdzmrstopnmef+r8/gakjcb</latexit> sha1_base="thmd1zfgltdt/dxtpehmi/io8=">aaab8xicbzdlsgmxfibpek1vnxpjlgevwmfnrzdooygr1gozmmmldm8mqzjqyzfucagiw9/gnw9jscw8ifpznhhloh8scaeo8ktrxmzhqi9suxzobgmzkekbrhkpoghwldnbmyztjuxojgkog0h+tpvf1ilwzsjljtp0idwulgchgwvdpd+l1k+rtaxfkrsvdya0dfozcjvje+egnjkogkqzjwuuusfftrawjngbfxqjpjmkydnxosar1xzhdp9yzofaq+rbm/friojrsdrydsjbezsty1/t1exne+iktcwkoipopwoqji9h0fdrgihldjxywuczuisgik0ymdaloq/awt1gvrxiwbtletxerwfoiytoamplqaon9cajhaq8ayv8ozo8vdzmrstopnmef+r8/gakjcb</latexit> sha1_base="thmd1zfgltdt/dxtpehmi/io8=">aaab8xicbzdlsgmxfibpek1vnxpjlgevwmfnrzdooygr1gozmmmldm8mqzjqyzfucagiw9/gnw9jscw8ifpznhhloh8scaeo8ktrxmzhqi9suxzobgmzkekbrhkpoghwldnbmyztjuxojgkog0h+tpvf1ilwzsjljtp0idwulgchgwvdpd+l1k+rtaxfkrsvdya0dfozcjvje+egnjkogkqzjwuuusfftrawjngbfxqjpjmkydnxosar1xzhdp9yzofaq+rbm/friojrsdrydsjbezsty1/t1exne+iktcwkoipopwoqji9h0fdrgihldjxywuczuisgik0ymdaloq/awt1gvrxiwbtletxerwfoiytoamplqaon9cajhaq8ayv8ozo8vdzmrstopnmef+r8/gakjcb</latexit> sha1_base="gmkkspdvspbdyqajov0ehkvs=">aaacoxicbvdlsgmxfmuvvqkswsjuxdltfnrtkhxjsoj9qgcznk0du1mhisjlgf+y1/uw0irt/ambylrvinhvopunu8ujgptlnzyozsrqvphdzg1t+zufcpjkibcythlbadd0kcam+asmqgomggidumdlxjleprkjqtlav1xtkdgcjxwpbgptbnjurhlcsnywmsqvvseufqbtbrutcr8dvru1qvglv+rgjsutbgolodsiyfn0npd/ilud+rmcbjnbx8cwfkibfnd8kz0icmsjrzbduvysm1rojisimjekz0eshahp0ij0npqrj9kjzsn8eqzazgmhd+gjppyngxmop9/qkroslwu/e/rrwpctudynffdx/abgxqakyxgghvbcsfqdhaxvfvjatcsoed0yfyyyv/be1yydlplqonxzxzmeroazfyieluafxoalaaimh8alewlvxalwah8bnfdrjldyhfczx9/dquv</latexit> sha1_base="gmkkspdvspbdyqajov0ehkvs=">aaacoxicbvdlsgmxfmuvvqkswsjuxdltfnrtkhxjsoj9qgcznk0du1mhisjlgf+y1/uw0irt/ambylrvinhvopunu8ujgptlnzyozsrqvphdzg1t+zufcpjkibcythlbadd0kcam+asmqgomggidumdlxjleprkjqtlav1xtkdgcjxwpbgptbnjurhlcsnywmsqvvseufqbtbrutcr8dvru1qvglv+rgjsutbgolodsiyfn0npd/ilud+rmcbjnbx8cwfkibfnd8kz0icmsjrzbduvysm1rojisimjekz0eshahp0ij0npqrj9kjzsn8eqzazgmhd+gjppyngxmop9/qkroslwu/e/rrwpctudynffdx/abgxqakyxgghvbcsfqdhaxvfvjatcsoed0yfyyyv/be1yydlplqonxzxzmeroazfyieluafxoalaaimh8alewlvxalwah8bnfdrjldyhfczx9/dquv</latexit> sha1_base="gmkkspdvspbdyqajov0ehkvs=">aaacoxicbvdlsgmxfmuvvqkswsjuxdltfnrtkhxjsoj9qgcznk0du1mhisjlgf+y1/uw0irt/ambylrvinhvopunu8ujgptlnzyozsrqvphdzg1t+zufcpjkibcythlbadd0kcam+asmqgomggidumdlxjleprkjqtlav1xtkdgcjxwpbgptbnjurhlcsnywmsqvvseufqbtbrutcr8dvru1qvglv+rgjsutbgolodsiyfn0npd/ilud+rmcbjnbx8cwfkibfnd8kz0icmsjrzbduvysm1rojisimjekz0eshahp0ij0npqrj9kjzsn8eqzazgmhd+gjppyngxmop9/qkroslwu/e/rrwpctudynffdx/abgxqakyxgghvbcsfqdhaxvfvjatcsoed0yfyyyv/be1yydlplqonxzxzmeroazfyieluafxoalaaimh8alewlvxalwah8bnfdrjldyhfczx9/dquv</latexit> sha1_base="gmkkspdvspbdyqajov0ehkvs=">aaacoxicbvdlsgmxfmuvvqkswsjuxdltfnrtkhxjsoj9qgcznk0du1mhisjlgf+y1/uw0irt/ambylrvinhvopunu8ujgptlnzyozsrqvphdzg1t+zufcpjkibcythlbadd0kcam+asmqgomggidumdlxjleprkjqtlav1xtkdgcjxwpbgptbnjurhlcsnywmsqvvseufqbtbrutcr8dvru1qvglv+rgjsutbgolodsiyfn0npd/ilud+rmcbjnbx8cwfkibfnd8kz0icmsjrzbduvysm1rojisimjekz0eshahp0ij0npqrj9kjzsn8eqzazgmhd+gjppyngxmop9/qkroslwu/e/rrwpctudynffdx/abgxqakyxgghvbcsfqdhaxvfvjatcsoed0yfyyyv/be1yydlplqonxzxzmeroazfyieluafxoalaaimh8alewlvxalwah8bnfdrjldyhfczx9/dquv</latexit> sha1_base="8udf8dveqnsaqmiynnbydvdus=">aaabhicbzbns8naeiyn9avwrphltf8fqsefqifl1bmf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwzcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctktapowgncarnmev1oaetaebgjp8apvzqpzrwhvwgppphmmfoz8/jm+mwq==</latexit> sha1_base="8udf8dveqnsaqmiynnbydvdus=">aaabhicbzbns8naeiyn9avwrphltf8fqsefqifl1bmf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwzcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctktapowgncarnmev1oaetaebgjp8apvzqpzrwhvwgppphmmfoz8/jm+mwq==</latexit> sha1_base="8udf8dveqnsaqmiynnbydvdus=">aaabhicbzbns8naeiyn9avwrphltf8fqsefqifl1bmf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwzcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctktapowgncarnmev1oaetaebgjp8apvzqpzrwhvwgppphmmfoz8/jm+mwq==</latexit> K sha1_base="i0jzreoqzlhpokx8gyh90e=">aaabhicbzbns8naeiyn9avwrphltf8fqsefry9cjacf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctksapowgncarnmev1oaotaebgjp8apvzqpzrwhvwgppphmmfoz8/ogemzw==</latexit> sha1_base="i0jzreoqzlhpokx8gyh90e=">aaabhicbzbns8naeiyn9avwrphltf8fqsefry9cjacf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctksapowgncarnmev1oaotaebgjp8apvzqpzrwhvwgppphmmfoz8/ogemzw==</latexit> sha1_base="i0jzreoqzlhpokx8gyh90e=">aaabhicbzbns8naeiyn9avwrphltf8fqsefry9cjacf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctksapowgncarnmev1oaotaebgjp8apvzqpzrwhvwgppphmmfoz8/ogemzw==</latexit> sha1_base="i0jzreoqzlhpokx8gyh90e=">aaabhicbzbns8naeiyn9avwrphltf8fqsefry9cjacf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctksapowgncarnmev1oaotaebgjp8apvzqpzrwhvwgppphmmfoz8/ogemzw==</latexit> Computation of DNNs } Each layer s computations can be represented as matrix-matrix multiplication (GEMM kernels) Layer Layer Fully-connected layer: Layer 1 w 1 sha1_base="9ij/nmfdhhuntmscpsybs8/w=">aaab8xicbzdlsgmxfibp1futtpln8eiucozvdbl0ylcvacvgyaaynzsrdklhkmg/hxouibn0bdnatslbf0h8pgfc8gfxbzporfjufldw19yizmlredrx/0niyuyqiersdqkskwecng0znhzirxeucnooxtftevurkskudotmporhgowmokntefhtja1k/pvkxfrrhvdya0dfofcjvje/egnjkogkqzjwuuusfftrawjngalxqjpjmkydnxosar1xzhdj9yzofaq+rbm/friojrsdrydsjbezsty1/t1exne+iktcwkoipopwoqji9h0fdrgihldjxywuczuisgik0ymdalkq/awt1gvqqwb9r9sv8jikcathcaoexeadbqabtsagblecrzovznzmwwtopnmif+r8/ga0lzcy</latexit> a = w X k=1 wka l 1 k + b l Conv layer: F C F C WH = sha1_base="8udf8dveqnsaqmiynnbydvdus=">aaabhicbzbns8naeiyn9avwrphltf8fqsefqifl1bmf+qbvkzjtp1yxcjlnbfmwdil9sd8nbhlt1hywhdbymtdibnfgdb+dwtrxuzwcbu0suf1a+pgrpofummywwseoevkpgepugggdrcgnaohtyhwqefugkeywczsdcpfdykdnqrnwzcrbtwdiycl0mfctxa/eigzphniwqbxuemi/iwqwnaaamxakwog9mhdi1kgqhs/miujmnqejywfngtu/piakt1japsz0tnsc/xzuz/twqwms/zjjduq+chmbtexmv1nblwhmjigtlfaejaiiznhssjyeb/nkvwhdvdljctktapowgncarnmev1oaetaebgjp8apvzqpzrwhvwgppphmmfoz8/jm+mwq==</latexit> First channel, unrolled WH W k F C I F C WH = O K WH

11 sha1_base="vmgyuyhde0aumzpsqmyg/dfxzvw=">aaad0icfvnnj9mwehutppbwsv0crgowliwalik9rlscici0rvqrynhd1ortrpakbbvfimsvp8enn8c/wgltajvvjpto+c0b+8ijjmplhsv1uef+fuvfshdkhjx/owwfpbwawyhbupuyqppzlofkabeh+lrlovszzzx8qpkxcsspvnwgz8pohmilgfbw1pmr9izjpyuhiphosipkqsgycv0gmwxcrggjtegagczjkcxtwtljiqjtdackogmnor9jbcxkpy+y8kixv/vaumuwwhwuqzaaqsalkyobwpdlpjxgxm8noxbdljmig/snscqwicmutrupuwo1+eqpfizqxhyogrnh/xvsragfv+9wkel0fjgp0ntnnxzlagz+npvsxqvugraghvrhf9z+ybicsu1memthybddeyfnscyoapkmsoto+nbbtzrubgkyv+zgjnqbgfrrwitukkiydqlipr9zu1+rijvyg1zmjocqgzhlhmomucsquqckwnifcokbd+8rznnqkapdaihhc/saiechz+9zy/r8dxgjjf+g1ctedi+ojaiob1vyx1fvmd/zc/+/weu9vlzdoe//mvjeavaq==</latexit> sha1_base="vmgyuyhde0aumzpsqmyg/dfxzvw=">aaad0icfvnnj9mwehutppbwsv0crgowliwalik9rlscici0rvqrynhd1ortrpakbbvfimsvp8enn8c/wgltajvvjpto+c0b+8ijjmplhsv1uef+fuvfshdkhjx/owwfpbwawyhbupuyqppzlofkabeh+lrlovszzzx8qpkxcsspvnwgz8pohmilgfbw1pmr9izjpyuhiphosipkqsgycv0gmwxcrggjtegagczjkcxtwtljiqjtdackogmnor9jbcxkpy+y8kixv/vaumuwwhwuqzaaqsalkyobwpdlpjxgxm8noxbdljmig/snscqwicmutrupuwo1+eqpfizqxhyogrnh/xvsragfv+9wkel0fjgp0ntnnxzlagz+npvsxqvugraghvrhf9z+ybicsu1memthybddeyfnscyoapkmsoto+nbbtzrubgkyv+zgjnqbgfrrwitukkiydqlipr9zu1+rijvyg1zmjocqgzhlhmomucsquqckwnifcokbd+8rznnqkapdaihhc/saiechz+9zy/r8dxgjjf+g1ctedi+ojaiob1vyx1fvmd/zc/+/weu9vlzdoe//mvjeavaq==</latexit> sha1_base="vmgyuyhde0aumzpsqmyg/dfxzvw=">aaad0icfvnnj9mwehutppbwsv0crgowliwalik9rlscici0rvqrynhd1ortrpakbbvfimsvp8enn8c/wgltajvvjpto+c0b+8ijjmplhsv1uef+fuvfshdkhjx/owwfpbwawyhbupuyqppzlofkabeh+lrlovszzzx8qpkxcsspvnwgz8pohmilgfbw1pmr9izjpyuhiphosipkqsgycv0gmwxcrggjtegagczjkcxtwtljiqjtdackogmnor9jbcxkpy+y8kixv/vaumuwwhwuqzaaqsalkyobwpdlpjxgxm8noxbdljmig/snscqwicmutrupuwo1+eqpfizqxhyogrnh/xvsragfv+9wkel0fjgp0ntnnxzlagz+npvsxqvugraghvrhf9z+ybicsu1memthybddeyfnscyoapkmsoto+nbbtzrubgkyv+zgjnqbgfrrwitukkiydqlipr9zu1+rijvyg1zmjocqgzhlhmomucsquqckwnifcokbd+8rznnqkapdaihhc/saiechz+9zy/r8dxgjjf+g1ctedi+ojaiob1vyx1fvmd/zc/+/weu9vlzdoe//mvjeavaq==</latexit> sha1_base="vmgyuyhde0aumzpsqmyg/dfxzvw=">aaad0icfvnnj9mwehutppbwsv0crgowliwalik9rlscici0rvqrynhd1ortrpakbbvfimsvp8enn8c/wgltajvvjpto+c0b+8ijjmplhsv1uef+fuvfshdkhjx/owwfpbwawyhbupuyqppzlofkabeh+lrlovszzzx8qpkxcsspvnwgz8pohmilgfbw1pmr9izjpyuhiphosipkqsgycv0gmwxcrggjtegagczjkcxtwtljiqjtdackogmnor9jbcxkpy+y8kixv/vaumuwwhwuqzaaqsalkyobwpdlpjxgxm8noxbdljmig/snscqwicmutrupuwo1+eqpfizqxhyogrnh/xvsragfv+9wkel0fjgp0ntnnxzlagz+npvsxqvugraghvrhf9z+ybicsu1memthybddeyfnscyoapkmsoto+nbbtzrubgkyv+zgjnqbgfrrwitukkiydqlipr9zu1+rijvyg1zmjocqgzhlhmomucsquqckwnifcokbd+8rznnqkapdaihhc/saiechz+9zy/r8dxgjjf+g1ctedi+ojaiob1vyx1fvmd/zc/+/weu9vlzdoe//mvjeavaq==</latexit> sha1_base="gstzcuqcqfdxiaqdtylcacpk=">aaaebnichvpljtmwfpukpibwmasywfrmbaajsksbjbgsgeshrmpdqqhmdprdpozdsdvrqbpgvnixaicfwi/wcmkq9ogcq1ix+cex9fccz9r/u8dx1y9dr1rvezvu+wn9u+ekxqhijxjn1fmnnozn0bjjh9cxxfiuy09n8arontpvkmpltiobzkljgbjqem+8wbxmpojiummyvilzlnarrhlqdtvjuwqvdbgwaenubjzjrsmuufevojwuwandjnc0eowtffitpv+im1khqzhnakilvr0ssqfpwhqewshfznmtswytfana1gdvhltpbj/mlzxoxdnajzrbwclucvdbbwgkqxwa/oekyfjyysovnwfuhqxhqz9q8jadbcagjeppjedoykelyzwrpuk8hmtlvgzrji1txaapgs8ixoljtyhovzw9cwuewswcakftjaxt/usjhdzlevul9tzxmma/fduupj0evqymregsnjxuvpwadjyvwmymewjuslmfhmeovkjhumxrczwhgyd0cw8din0+hry/bceyc++aheaic8awcgdfggiwbctnvzjfk/vf/e+ujao+zeats8/bsm8ra==</latexit> sha1_base="gstzcuqcqfdxiaqdtylcacpk=">aaaebnichvpljtmwfpukpibwmasywfrmbaajsksbjbgsgeshrmpdqqhmdprdpozdsdvrqbpgvnixaicfwi/wcmkq9ogcq1ix+cex9fccz9r/u8dx1y9dr1rvezvu+wn9u+ekxqhijxjn1fmnnozn0bjjh9cxxfiuy09n8arontpvkmpltiobzkljgbjqem+8wbxmpojiummyvilzlnarrhlqdtvjuwqvdbgwaenubjzjrsmuufevojwuwandjnc0eowtffitpv+im1khqzhnakilvr0ssqfpwhqewshfznmtswytfana1gdvhltpbj/mlzxoxdnajzrbwclucvdbbwgkqxwa/oekyfjyysovnwfuhqxhqz9q8jadbcagjeppjedoykelyzwrpuk8hmtlvgzrji1txaapgs8ixoljtyhovzw9cwuewswcakftjaxt/usjhdzlevul9tzxmma/fduupj0evqymregsnjxuvpwadjyvwmymewjuslmfhmeovkjhumxrczwhgyd0cw8din0+hry/bceyc++aheaic8awcgdfggiwbctnvzjfk/vf/e+ujao+zeats8/bsm8ra==</latexit> sha1_base="gstzcuqcqfdxiaqdtylcacpk=">aaaebnichvpljtmwfpukpibwmasywfrmbaajsksbjbgsgeshrmpdqqhmdprdpozdsdvrqbpgvnixaicfwi/wcmkq9ogcq1ix+cex9fccz9r/u8dx1y9dr1rvezvu+wn9u+ekxqhijxjn1fmnnozn0bjjh9cxxfiuy09n8arontpvkmpltiobzkljgbjqem+8wbxmpojiummyvilzlnarrhlqdtvjuwqvdbgwaenubjzjrsmuufevojwuwandjnc0eowtffitpv+im1khqzhnakilvr0ssqfpwhqewshfznmtswytfana1gdvhltpbj/mlzxoxdnajzrbwclucvdbbwgkqxwa/oekyfjyysovnwfuhqxhqz9q8jadbcagjeppjedoykelyzwrpuk8hmtlvgzrji1txaapgs8ixoljtyhovzw9cwuewswcakftjaxt/usjhdzlevul9tzxmma/fduupj0evqymregsnjxuvpwadjyvwmymewjuslmfhmeovkjhumxrczwhgyd0cw8din0+hry/bceyc++aheaic8awcgdfggiwbctnvzjfk/vf/e+ujao+zeats8/bsm8ra==</latexit> sha1_base="gstzcuqcqfdxiaqdtylcacpk=">aaaebnichvpljtmwfpukpibwmasywfrmbaajsksbjbgsgeshrmpdqqhmdprdpozdsdvrqbpgvnixaicfwi/wcmkq9ogcq1ix+cex9fccz9r/u8dx1y9dr1rvezvu+wn9u+ekxqhijxjn1fmnnozn0bjjh9cxxfiuy09n8arontpvkmpltiobzkljgbjqem+8wbxmpojiummyvilzlnarrhlqdtvjuwqvdbgwaenubjzjrsmuufevojwuwandjnc0eowtffitpv+im1khqzhnakilvr0ssqfpwhqewshfznmtswytfana1gdvhltpbj/mlzxoxdnajzrbwclucvdbbwgkqxwa/oekyfjyysovnwfuhqxhqz9q8jadbcagjeppjedoykelyzwrpuk8hmtlvgzrji1txaapgs8ixoljtyhovzw9cwuewswcakftjaxt/usjhdzlevul9tzxmma/fduupj0evqymregsnjxuvpwadjyvwmymewjuslmfhmeovkjhumxrczwhgyd0cw8din0+hry/bceyc++aheaic8awcgdfggiwbctnvzjfk/vf/e+ujao+zeats8/bsm8ra==</latexit> sha1_base="sfdqxlxduf/jiwhpcdrajwhnla=">aaadsiczvjnb9qwehvsskvskri8vqjuvgpdksyilxykxbav1fdnoznequtpgivf/1woubfjld0qdjiuaetcgakwc9vpvz8nhmtpmm/haeg/c9tpgepnr8olo9mhqxorycoqvdnjndtq0saujsori1wnssyk/e9/mjubovuytlmtinz8bwurb0vpztsdblikocczymevtosv0hyt/nxfk0n0rzt1wqpqycnpqsjjk0jcd/1xagiiepbgxhvsxmhzzyywssbhxkucqhlkdymxufczpo1+j/sfrv01+uw0jnfjvdcibnamaxxki+sqisjqadqnhnzklcy9pyi1io8eibbzuxjwomw8n9zrsdrulhz1pqblzf1nkkyztarp1btxxeqeldzvxk/kzrosatnhwdymtorjrfcvalxytpawbaukb9zrvqsuouc/fpfotk9ppvgspxunhh9+m998ndmytf+qleuusskfyqdyqkzebgfb9+aiuay/hofhvfhjxrogq89zcimnn8cqgmptg==</latexit> sha1_base="sfdqxlxduf/jiwhpcdrajwhnla=">aaadsiczvjnb9qwehvsskvskri8vqjuvgpdksyilxykxbav1fdnoznequtpgivf/1woubfjld0qdjiuaetcgakwc9vpvz8nhmtpmm/haeg/c9tpgepnr8olo9mhqxorycoqvdnjndtq0saujsori1wnssyk/e9/mjubovuytlmtinz8bwurb0vpztsdblikocczymevtosv0hyt/nxfk0n0rzt1wqpqycnpqsjjk0jcd/1xagiiepbgxhvsxmhzzyywssbhxkucqhlkdymxufczpo1+j/sfrv01+uw0jnfjvdcibnamaxxki+sqisjqadqnhnzklcy9pyi1io8eibbzuxjwomw8n9zrsdrulhz1pqblzf1nkkyztarp1btxxeqeldzvxk/kzrosatnhwdymtorjrfcvalxytpawbaukb9zrvqsuouc/fpfotk9ppvgspxunhh9+m998ndmytf+qleuusskfyqdyqkzebgfb9+aiuay/hofhvfhjxrogq89zcimnn8cqgmptg==</latexit> sha1_base="sfdqxlxduf/jiwhpcdrajwhnla=">aaadsiczvjnb9qwehvsskvskri8vqjuvgpdksyilxykxbav1fdnoznequtpgivf/1woubfjld0qdjiuaetcgakwc9vpvz8nhmtpmm/haeg/c9tpgepnr8olo9mhqxorycoqvdnjndtq0saujsori1wnssyk/e9/mjubovuytlmtinz8bwurb0vpztsdblikocczymevtosv0hyt/nxfk0n0rzt1wqpqycnpqsjjk0jcd/1xagiiepbgxhvsxmhzzyywssbhxkucqhlkdymxufczpo1+j/sfrv01+uw0jnfjvdcibnamaxxki+sqisjqadqnhnzklcy9pyi1io8eibbzuxjwomw8n9zrsdrulhz1pqblzf1nkkyztarp1btxxeqeldzvxk/kzrosatnhwdymtorjrfcvalxytpawbaukb9zrvqsuouc/fpfotk9ppvgspxunhh9+m998ndmytf+qleuusskfyqdyqkzebgfb9+aiuay/hofhvfhjxrogq89zcimnn8cqgmptg==</latexit> sha1_base="sfdqxlxduf/jiwhpcdrajwhnla=">aaadsiczvjnb9qwehvsskvskri8vqjuvgpdksyilxykxbav1fdnoznequtpgivf/1woubfjld0qdjiuaetcgakwc9vpvz8nhmtpmm/haeg/c9tpgepnr8olo9mhqxorycoqvdnjndtq0saujsori1wnssyk/e9/mjubovuytlmtinz8bwurb0vpztsdblikocczymevtosv0hyt/nxfk0n0rzt1wqpqycnpqsjjk0jcd/1xagiiepbgxhvsxmhzzyywssbhxkucqhlkdymxufczpo1+j/sfrv01+uw0jnfjvdcibnamaxxki+sqisjqadqnhnzklcy9pyi1io8eibbzuxjwomw8n9zrsdrulhz1pqblzf1nkkyztarp1btxxeqeldzvxk/kzrosatnhwdymtorjrfcvalxytpawbaukb9zrvqsuouc/fpfotk9ppvgspxunhh9+m998ndmytf+qleuusskfyqdyqkzebgfb9+aiuay/hofhvfhjxrogq89zcimnn8cqgmptg==</latexit> sha1_base="/cmi1uxs9gjdz+qvloxkouays=">aaackhicbvfnt9wwehvcawkkzuupvviskvweekccq1gbxqqeqgibar1fjjpztbcdyjgrql8nvfvpv8cptba8ydabetoed+e1kgj+g8qrr1af/1m0bnpr/fbgw81qxorycqqvdnbndtq0saijsqrs1wnsuye++z/wbebovuykzzwkmk+mlkxgfzddzwsoa+xtncqktqgukshyzhcbstezptrhk91efxgwzt0llf/xvycfdfypdfhwj0lewbrphmrwtqaydlmgnvdkugrmugwzjvxgbukqsngxjjts8icvlwg0gbskozdohrtlluuqofvphfqchhjzd1hbfj0xc+oz+8paflzfwzshxco+xauznofaqfy+qeapns9qwfibawpgwqjhguvjajy0fnv0ejaekhmnnc/b98rfvnuuud/hffqvj8fvyvb+xehodw99exqtrxfkfjosinjifikmiaigopgaasothbfwde0dpqcj+qjwp8pctbeqa==</latexit> sha1_base="/cmi1uxs9gjdz+qvloxkouays=">aaackhicbvfnt9wwehvcawkkzuupvviskvweekccq1gbxqqeqgibar1fjjpztbcdyjgrql8nvfvpv8cptba8ydabetoed+e1kgj+g8qrr1af/1m0bnpr/fbgw81qxorycqqvdnbndtq0saijsqrs1wnsuye++z/wbebovuykzzwkmk+mlkxgfzddzwsoa+xtncqktqgukshyzhcbstezptrhk91efxgwzt0llf/xvycfdfypdfhwj0lewbrphmrwtqaydlmgnvdkugrmugwzjvxgbukqsngxjjts8icvlwg0gbskozdohrtlluuqofvphfqchhjzd1hbfj0xc+oz+8paflzfwzshxco+xauznofaqfy+qeapns9qwfibawpgwqjhguvjajy0fnv0ejaekhmnnc/b98rfvnuuud/hffqvj8fvyvb+xehodw99exqtrxfkfjosinjifikmiaigopgaasothbfwde0dpqcj+qjwp8pctbeqa==</latexit> sha1_base="/cmi1uxs9gjdz+qvloxkouays=">aaackhicbvfnt9wwehvcawkkzuupvviskvweekccq1gbxqqeqgibar1fjjpztbcdyjgrql8nvfvpv8cptba8ydabetoed+e1kgj+g8qrr1af/1m0bnpr/fbgw81qxorycqqvdnbndtq0saijsqrs1wnsuye++z/wbebovuykzzwkmk+mlkxgfzddzwsoa+xtncqktqgukshyzhcbstezptrhk91efxgwzt0llf/xvycfdfypdfhwj0lewbrphmrwtqaydlmgnvdkugrmugwzjvxgbukqsngxjjts8icvlwg0gbskozdohrtlluuqofvphfqchhjzd1hbfj0xc+oz+8paflzfwzshxco+xauznofaqfy+qeapns9qwfibawpgwqjhguvjajy0fnv0ejaekhmnnc/b98rfvnuuud/hffqvj8fvyvb+xehodw99exqtrxfkfjosinjifikmiaigopgaasothbfwde0dpqcj+qjwp8pctbeqa==</latexit> sha1_base="/cmi1uxs9gjdz+qvloxkouays=">aaackhicbvfnt9wwehvcawkkzuupvviskvweekccq1gbxqqeqgibar1fjjpztbcdyjgrql8nvfvpv8cptba8ydabetoed+e1kgj+g8qrr1af/1m0bnpr/fbgw81qxorycqqvdnbndtq0saijsqrs1wnsuye++z/wbebovuykzzwkmk+mlkxgfzddzwsoa+xtncqktqgukshyzhcbstezptrhk91efxgwzt0llf/xvycfdfypdfhwj0lewbrphmrwtqaydlmgnvdkugrmugwzjvxgbukqsngxjjts8icvlwg0gbskozdohrtlluuqofvphfqchhjzd1hbfj0xc+oz+8paflzfwzshxco+xauznofaqfy+qeapns9qwfibawpgwqjhguvjajy0fnv0ejaekhmnnc/b98rfvnuuud/hffqvj8fvyvb+xehodw99exqtrxfkfjosinjifikmiaigopgaasothbfwde0dpqcj+qjwp8pctbeqa==</latexit> Computation Distribution of DNNs } Methods distributing computation of a model* Fully-connected Layers Output splitting: Input splitting: Hadidi, Ramyad, et al "Collaborative Execution of Deep Neural Networks on Internet of Things Devices" arxiv preprint arxiv:19010 (019) w 11 w 1 w 1k w 1 w w k w 1 w w k w m1 w m w mk Weights (divided among nodes) w 11 w 1 w 1k w 1 w w k w 1 w w k w m1 w m w mk Weights (divided among nodes) m k m k } Same can be applied on conv layers* } Channel, spatial, and filter splitting a 0 1 a 0 a 0 a 0 k k 1 Inputs (every node needs a copy) a 0 1 a 0 a 0 a 0 k = k 1 = a 1 a a a m m 1 Outputs (each node independently) Inputs Outputs (divided among nodes) (each node calculates partial sums) a 1 a m a 1 a m m 1 m 1 = a 1 a a a m m 1

12 Coded Distributed Computing (CDC) } Designed for MapReduce workloads (018)* } Preforming redundant or coded computer per node to reduce communication This work: DNNs on IoT More Compute / Node = More Reliability * Li, Songze, et al "A fundamental tradeoff between computation and communication in distributed computing" IEEE Transactions on Information Theory 1 (018):

13 Using CDC for Robustness } Add column-wise summation of the weights: } The new weights are constant, so done in offline } Distribute outputs among nodes }Thus, applicable only to output-splitting methods

14 sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="0hc81e1zkrevtkduaco0rss+ymk=">aaabicbzbnswmxeizn1etx1wpxojf8frrdbj0yvhcrywqvk0wbmmsxzfyos/+cfw+kepupefpfmlz0nyxag/vzjczn0qlsoj1pbx1jcu8xdnzds/qbetwsgczbljgjutucik0bfaytupvrfkj9g9tz/fgjgyss/yctliekdrwibamsou/1qza/cfvcaqoqafmv/rvgyqsu1wjk9tabucngobuogcstyu9zpkusjed8qdtrwytfdurondmgcwlc00jmu+jncprjypynyriycxzuz/twg8xwyc1mydvbfbrnkmbczoetgtccozwomwitythiooqxdpxyuqlj+8culeud/rlwucnikmmjnmibhafdbidjrsawqierxepow9eo/exk1buzx/bhucpmeouw==</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> How to Distribute CDC and Recover? } Add column-wise summation of the weights: }Simple example (one output/device) }Recovery } Subtraction vs Multiplication } You also needs the weights, that X X X X X X X X X you would not have in the final node }Multiple out/device: Just create a new weight matrix [ sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> X X X Output Splitting for nodes One Failure Tolerance [ sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> X X X X X X [ [ [ sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> Output Splitting for nodes Two Failures Tolerance [ sha1_base="mmilieak1suevxtmwgdhaxvu=">aaabhicbzbns8naeiynftbvfxozbeinkoighlxjyyj8gdwwznbrrnuwuxfkc/wkerr/kb/bt0ovrcwsmm+zmgaca+o8a+sbm1nzppyt9wwdkbuskuwxblbgjozuo+aswybgd1uiy1dgz1wfdurdqazibznjmyjpupkimqs1ftlapbc+ciq+avuivcjxlqzdiwbajnexqrxptuquuezgt9zknkwvjoktfoqqxicflzol9yzkchr9klduvizzgwk/i0hbg1iz0cm1m/lfzmxpdbdmxawzqssvhusaiscjsajlgcpkrewuukwjwxefwxgzloixjlj9c+lmwwevevrrwloiuzuaaprqeod9cafjbaeizxehmenrfnflytkxcwj/jhz+qo/fzv</latexit> [ [