5.Neural-Networks
L
�
��1HXUDO�1HWZRUNV
*KRODPUH]D�+DbDUL
LL
�
��1HXUDO�1HWZRUNV
*KRODPUH]D�+DeDUL
*HQHUDWHG�E\�$OH[DQGULD��KWWSV���ZZZ�DOH[DQGULDUHSRVLWRU\�RUJ��RQ�0DUFK����������DW�������SP�$(‘7
��$SSHQGL[��+�2�/LEUDU\
LLL
&RQWHQWV
7LWOH� L�����������������������������������������������������������������������������������������������������������������������������������������������
&RS\ULJKW� LL�������������������������������������������������������������������������������������������������������������������������������������
��)HHG�)RUZDUG�1HXUDO�1HWZRUNV� ��������������������������������������������������������������������������������������������
��1HWZRUN�7UDLQLQJ� ���������������������������������������������������������������������������������������������������������������������
��5HJXODULVDWLRQ� �������������������������������������������������������������������������������������������������������������������������
��$FWLYLW\������1HXUDO�1HWZRUN� ������������������������������������������������������������������������������������������������
��8QVXSHUYLVHG�DQG�6HOI�7DXJKW�/HDUQLQJ� ����������������������������������������������������������������������������
��$FWLYLW\������$XWRHQFRGHU� �����������������������������������������������������������������������������������������������������
��237,21$/��&RQYROXWLRQDO�1HXUDO�1HWZRUNV� �����������������������������������������������������������������������
��$SSHQGL[��+�2�/LEUDU\� ����������������������������������������������������������������������������������������������������������
L
��)HHG�)RUZDUG�1HXUDO�1HWZRUNV
�
�
�
)HHG�)RUZDUG�1HXUDO�1HWZRUNV
7KH�%DVLFV
1HXURQ��7R�GHVFULEH�QHXUDO�QHWZRUNV��ZH�ZLOO�EHJLQ�E\�GHVFULELQJ�WKH�VLPSOHVW�SRVVLEOH�QHXUDO�QHWZRUN�
RQH�ZKLFK�FRPSULVHV�D�VLQJOH�QHXURQ��:H�ZLOO�XVH�WKH�IROORZLQJ�GLDJUDP�WR�GHQRWH�D�VLQJOH�QHXURQ�
�KWWSV���ZZZ�DOH[DQGULDUHSRVLWRU\�RUJ�ZS�FRQWHQW�XSORDGV��������
��������6LQJOH1HXURQ�SQJ�
)LJXUH�������$�VLQJOH�QHXURQ
7KLV�QHXURQ�LV�D�FRPSXWDWLRQDO�XQLW�WKDW�WDNHV�DV�LQSXW� ��DQG�D����LQWHUFHSW�WHUP��
DQG�RXWSXWV� �ZKHUH� �LV�FDOOHG�WKH�DFWLYDWLRQ
IXQFWLRQ�
$FWLYDWLRQ�)XQFWLRQ��:H�XVXDOO\�FKRRVH� �WR�EH�WKH�VLJPRLG�IXQFWLRQ�
7KH�RXWSXW�UDQJH�RI�WKH�VLJPRLG�IXQFWLRQ�LV�>���@��$QRWKHU�FRPPRQ�FKRLFH�IRU� �LV�WKH�K\SHUEROLF
WDQJHQW��RU�WDQK�IXQFWLRQ�
7KH�RXWSXW�UDQJH�RI�WKH�WDQK�IXQFWLRQ�LV�>����@��,Q�WHUPV�RI�WKH�RXWSXW�UDQJH��WKH�WDQK�IXQFWLRQ�LV�D
UHVFDOHG�YHUVLRQ�RI�WKH�VLJPRLG�IXQFWLRQ��)LJXUH���������
��)HHG�)RUZDUG�1HXUDO�1HWZRUNV
�
)LJXUH��������7KUHH�DFWLYDWLRQ�IXQFWLRQV��WDQK��VLJPRLG�DQG�UHFWLcHG�OLQHDU�
/HW
V�KDYH�D�ORRN�RQ�WKH�GHULYDWLYHV�RI�WKHVH�DFWLYDWLRQV�IXQFWLRQV��VLQFH�ZH�ZLOO�XVH�WKHP�IRU�WKH�WUDLQLQJ
RI�WKH�PRGHO��H[SODLQHG�LQ�WKH�QH[W�FKDSWHU��
1HXUDO�1HWZRUNV
1HXUDO�1HWZRUN�0RGHO��$�QHXUDO�QHWZRUN�LV�SXW�WRJHWKHU�E\�KRRNLQJ�WRJHWKHU�PDQ\�RI�RXU�VLPSOH
QHXURQV��VR�WKDW�WKH�RXWSXW�RI�D�QHXURQ�FDQ�EH�WKH�LQSXW�RI�DQRWKHU��)RU�H[DPSOH��KHUH�LV�D�VPDOO�QHXUDO
QHWZRUN�
��)HHG�)RUZDUG�1HXUDO�1HWZRUNV
�
�KWWSV���ZZZ�DOH[DQGULDUHSRVLWRU\�RUJ�ZS�FRQWHQW�XSORDGV����������������1HWZRUN����SQJ�
)LJXUH��������$���OD\HU�QHXUDO�QHWZRUN
,Q�WKLV�fJXUH��ZH�KDYH�XVHG�FLUFOHV�WR�DOVR�GHQRWH�WKH�LQSXWV�WR�WKH�QHWZRUN��7KH�FLUFOHV�ODEHOHG������DUH
FDOOHG�ELDV�XQLWV��DQG�FRUUHVSRQG�WR�WKH�LQWHUFHSW�WHUP��7KH�OHIWPRVW�OD\HU�RI�WKH�QHWZRUN�LV�FDOOHG�WKH
LQSXW�OD\HU��DQG�WKH�ULJKWPRVW�OD\HU�WKH�RXWSXW�OD\HU��ZKLFK��LQ�WKLV�H[DPSOH��KDV�RQO\�RQH�QRGH���7KH
PLGGOH�OD\HU�RI�QRGHV�LV�FDOOHG�WKH�KLGGHQ�OD\HU��EHFDXVH�LWV�YDOXHV�DUH�QRW�REVHUYHG�LQ�WKH�WUDLQLQJ�VHW�
:H�DOVR�VD\�WKDW�RXU�H[DPSOH�QHXUDO�QHWZRUN�KDV���LQSXW�XQLWV��QRW�FRXQWLQJ�WKH�ELDV�XQLW�����KLGGHQ
XQLWV��DQG���RXWSXW�XQLW�
1HWZRUN�3DUDPHWHUV��/HW
V�GHQRWH�WKH�QXPEHU�RI�OD\HUV�LQ�RXU�QHWZRUN�E\� ��WKXV� �LQ�RXU
H[DPSOH��/HW
V�ODEHO�OD\HU� �DV� ��VR�OD\HU� �LV�WKH�LQSXW�OD\HU��DQG�OD\HU� �WKH�RXWSXW�OD\HU��2XU
QHXUDO�QHWZRUN�KDV�SDUDPHWHUV� ��ZKHUH�ZH�ZULWH� �WR�GHQRWH�WKH
SDUDPHWHU��RU�ZHLJKW��DVVRFLDWHG�ZLWK�WKH�FRQQHFWLRQ�EHWZHHQ�XQLW� �LQ�OD\HU� ��DQG�XQLW� �LQ�OD\HU�
�QRWH�WKH�RUGHU�RI�WKH�LQGLFHV���$OVR�� �LV�WKH�ELDV�DVVRFLDWHG�ZLWK�XQLW� �LQ�OD\HU� ��7KXV��LQ�RXU
H[DPSOH��ZH�KDYH� ��DQG� ��1RWH�WKDW�ELDV�XQLWV�GRQ
W�KDYH�LQSXWV�RU
FRQQHFWLRQV�JRLQJ�LQWR�WKHP��VLQFH�WKH\�DOZD\V�RXWSXW�WKH�YDOXH�����:H�DOVR�OHW� �GHQRWH�WKH�QXPEHU�RI
QRGHV�LQ�OD\HU� ��QRW�FRXQWLQJ�WKH�ELDV�XQLW��
1HXURQ
V�$FWLYDWLRQ��/HW� �GHQRWH�WKH�WRWDO�ZHLJKWHG�VXP�RI�LQSXWV�WR�XQLW� �LQ�OD\HU� ��LQFOXGLQJ�WKH
ELDV�WHUP��H�J��� ���7KHQ��WKH�RXWSXW�RI�WKH�QHXWURQ��DND�LWV�DFWLYDWLRQ��LV
��)HHG�)RUZDUG�1HXUDO�1HWZRUNV
�
GHQRWHG�E\� �
)RUZDUG�3URSDJDWLRQ��*LYHQ�D�f[HG�VHWWLQJ�RI�WKH�SDUDPHWHUV� ��RXU�QHXUDO�QHWZRUN�GHfQHV�D�IXQFWLRQ
�WKDW�RXWSXWV�D�UHDO�QXPEHU��6SHFLfFDOO\��WKH�FRPSXWDWLRQ�WKDW�RXU�H[DPSOH�QHXUDO�QHWZRUN
UHSUHVHQWV�LV�JLYHQ�E\�
1RWH�WKDW�WKLV�HDVLO\�OHQGV�LWVHOI�WR�D�PRUH�FRPSDFW�QRWDWLRQ��6SHFLfFDOO\��LI�ZH�H[WHQG�WKH�DFWLYDWLRQ
IXQFWLRQ� �WR�DSSO\�WR�YHFWRUV�LQ�DQ�HOHPHQW�ZLVH�IDVKLRQ��L�H��
���WKHQ�ZH�FDQ�ZULWH�WKH�HTXDWLRQV�DERYH�PRUH�FRPSDFWO\
DV�
:H�FDOO�WKLV�VWHS�IRUZDUG�SURSDJDWLRQ��0RUH�JHQHUDOO\��UHFDOOLQJ�WKDW�ZH�XVH� �WR�DOVR�GHQRWH�WKH
YDOXHV�IURP�WKH�LQSXW�OD\HU��WKHQ�JLYHQ�OD\HU�
V�DFWLYDWLRQV� ��ZH�FDQ�FRPSXWH�OD\HU�
V
DFWLYDWLRQV� �DV�
%\�RUJDQL]LQJ�RXU�SDUDPHWHUV�LQ�PDWULFHV�DQG�XVLQJ�PDWUL[�YHFWRU�RSHUDWLRQV��H�J��SURYLGHG�E\�*38V���ZH
FDQ�WDNH�DGYDQWDJH�RI�IDVW�OLQHDU�DOJHEUD�URXWLQHV�WR�TXLFNO\�SHUIRUP�FDOFXODWLRQV�LQ�RXU�QHWZRUN�
)HHG�)RUZDUG�1HXUDO�1HWZRUN��:H�KDYH�VR�IDU�IRFXVHG�RQ�RQH�H[DPSOH�QHXUDO�QHWZRUN��EXW�RQH�FDQ
DOVR�EXLOG�QHXUDO�QHWZRUNV�ZLWK�RWKHU�DUFKLWHFWXUHV��PHDQLQJ�SDWWHUQV�RI�FRQQHFWLYLW\�EHWZHHQ�QHXURQV��
LQFOXGLQJ�RQHV�ZLWK�PXOWLSOH�KLGGHQ�OD\HUV��7KH�PRVW�FRPPRQ�FKRLFH�LV�D� �OD\HUHG�QHWZRUN�ZKHUH�OD\HU
�LV�WKH�LQSXW�OD\HU��OD\HU� �LV�WKH�RXWSXW�OD\HU��DQG�HDFK�OD\HU� �LV�GHQVHO\�FRQQHFWHG�WR�OD\HU� ��,Q
WKLV�VHWWLQJ��WR�FRPSXWH�WKH�RXWSXW�RI�WKH�QHWZRUN��ZH�FDQ�VXFFHVVLYHO\�FRPSXWH�DOO�WKH�DFWLYDWLRQV�LQ
OD\HU� ��WKHQ�OD\HU� ��DQG�VR�RQ��XS�WR�OD\HU� ��XVLQJ�WKH�HTXDWLRQV�DERYH�WKDW�GHVFULEH�WKH�IRUZDUG
SURSDJDWLRQ�VWHS��7KLV�LV�RQH�H[DPSOH�RI�D�IHHGIRUZDUG�QHXUDO�QHWZRUN��VLQFH�WKH�FRQQHFWLYLW\�JUDSK�GRHV
QRW�KDYH�DQ\�GLUHFWHG�ORRSV�RU�F\FOHV�
��)HHG�)RUZDUG�1HXUDO�1HWZRUNV
�
1HXUDO�QHWZRUNV�FDQ�DOVR�KDYH�PXOWLSOH�RXWSXW�XQLWV��)RU�H[DPSOH��KHUH�LV�D�QHWZRUN�ZLWK�WZR�KLGGHQ
OD\HUV�OD\HUV� �DQG� �DQG�WZR�RXWSXW�XQLWV�LQ�OD\HU� �
�KWWSV���ZZZ�DOH[DQGULDUHSRVLWRU\�RUJ�ZS�FRQWHQW�XSORDGV����������������1HWZRUN�����SQJ�
)LJXUH��������$���OD\HU�QHXUDO�QHWZRUN�ZLWK�WZR�XQLWV�DW�WKH�RXWSXW�OD\HU�
7R�WUDLQ�WKLV�QHWZRUN��ZH�ZRXOG�QHHG�WUDLQLQJ�H[DPSOHV� �ZKHUH� ��7KLV�VRUW�RI�QHWZRUN
LV�XVHIXO�LI�WKHUH�DUH�PXOWLSOH�RXWSXWV�WKDW�\RX�DUH�LQWHUHVWHG�LQ�SUHGLFWLQJ��)RU�H[DPSOH��LQ�D�PHGLFDO
GLDJQRVLV�DSSOLFDWLRQ��WKH�YHFWRU� �PLJKW�JLYH�WKH�LQSXW�IHDWXUHV�RI�D�SDWLHQW��DQG�WKH�GLeHUHQW�RXWSXWV�
V�PLJKW�LQGLFDWH�SUHVHQFH�RU�DEVHQFH�RI�GLeHUHQW�GLVHDVHV�
11V�YV�3HUFHSWURQ��$V�FDQ�EH�VHHQ�IURP�WKH�DERYH�DUFKLWHFWXUHV��WKH�QHXUDO�QHWZRUN�PRGHO�FRPSULVHV
PXOWLSOH�VWDJHV�RI�SURFHVVLQJ��HDFK�RI�ZKLFK�UHVHPEOHV�WKH�SHUFHSWURQ�PRGHO�RI�0RGXOH����DQG�IRU�WKLV
UHDVRQ�WKH�QHXUDO�QHWZRUN�LV�DOVR�NQRZQ�DV�WKH�PXOWLOD\HU�SHUFHSWURQ��RU�0/3��$�NH\�GLeHUHQFH�FRPSDUHG
WR�WKH�SHUFHSWURQ��KRZHYHU��LV�WKDW�WKH�QHXUDO�QHWZRUN�XVHV�FRQWLQXRXV�QRQOLQHDULWLHV�LQ�WKH�KLGGHQ�XQLWV
�H�J�� �RU� ���ZKHUHDV�WKH�SHUFHSWURQ�XVHV�VWHS�IXQFWLRQ�QRQOLQHDULWLHV��7KLV�PHDQV�WKDW�WKH
QHXUDO�QHWZRUN�IXQFWLRQ�LV�GLeHUHQWLDEOH�ZLWK�UHVSHFW�WR�WKH�QHWZRUN�SDUDPHWHUV��DQG�WKLV�SURSHUW\�ZLOO
SOD\�D�FHQWUDO�UROH�LQ�QHWZRUN�WUDLQLQJ��ZKLFK�ZH�ZLOO�VHH�LQ�WKH�QH[W�&KDSWHU��
7KH�3RZHU�RI�1HXUDO�1HWZRUNV
7KH�DSSUR[LPDWLRQ�SURSHUWLHV�RI�IHHG�IRUZDUG�QHWZRUNV�KDYH�EHHQ�ZLGHO\�VWXGLHG�DQG�IRXQG�WR�EH�YHU\
JHQHUDO��WKH�PRGHO�FODVV�FRUUHVSRQGLQJ�WR�QHXUDO�QHWZRUNV�FDQ�UHSUHVHQW�DOPRVW�DQ\�IXQFWLRQ��JLYHQ
VRPH�PLQRU�FRQGLWLRQV���1HXUDO�QHWZRUNV�DUH�WKHUHIRUH�VDLG�WR�EH�XQLYHUVDO�DSSUR[LPDWRUV��)RU�H[DPSOH��D
WZR�OD\HU�QHWZRUN�ZLWK�OLQHDU�RXWSXWV�FDQ�XQLIRUPO\�DSSUR[LPDWH�DQ\�FRQWLQXRXV�IXQFWLRQ�RQ�DQ�LQSXW
GRPDLQ�WR�DUELWUDU\�DFFXUDF\�SURYLGHG�WKH�QHWZRUN�KDV�D�VXhFLHQWO\�ODUJH�QXPEHU�RI�KLGGHQ�XQLWV��7KLV
UHVXOW�KROGV�IRU�D�ZLGH�UDQJH�RI�KLGGHQ�XQLW�DFWLYDWLRQ�IXQFWLRQV��EXW�H[FOXGLQJ�SRO\QRPLDOV�
,Q�WKH�FDVH�RI�FODVVLfFDWLRQ�SUREOHPV��WKLV�UHVXOW�HQVXUHV�WKDW�QHXUDO�QHWZRUNV�FDQ�DSSUR[LPDWH�WKH�WDUJHW
GHFLVLRQ�ERXQGDU\�WR�DQ\�UHTXLUHG�SUHFLVLRQ��6LPLODUO\��LQ�WKH�FDVH�RI�UHJUHVVLRQ�SUREOHPV��WKLV�UHVXOW
HQVXUHV�WKDW�WKH�QHXUDO�QHWZRUN�PRGHO�FDQ�DSSUR[LPDWH�WKH�WDUJHW�IXQFWLRQ�WR�DQ\�SUHFLVLRQ��+RZHYHU�
��)HHG�)RUZDUG�1HXUDO�1HWZRUNV
�
WKH�SULFH�WR�SD\�LQ�WKHVH�FDVHV�LV�WKH�QXPEHU�RI�QHXWURQV�LQ�WKH�KLGGHQ�OD\HU��DV�WKH�QXPEHU�RI�QHXURQV
JURZV��WKH�QXPEHU�RI�SDUDPHWHUV�JURZV�DQG�WKH�QHWZRUN�KDV�PRUH�WHQGHQF\�WR�RYHUfW�WKH�WUDLQLQJ�GDWD�
7KH�RYHUfWWLQJ�FDQ�EH�SUHYHQWHG�E\�����XVLQJ�D�ODUJH�WUDLQLQJ�GDWD������XVLQJ�SURSHU�UHJXODULVDWLRQ
PHWKRGV��DQG�����XVLQJ�GHHS�DUFKLWHFWXUH�ZKHUH�WKH�QHWZRUN�FDQ�UHSUHVHQW�WKH�VDPH�PRGHO�FODVV�DV�D
VKDOORZ�DUFKLWHFWXUH�EXW�ZLWK�D�PXFK�VPDOOHU�QXPEHU�RI�QHXURQV�
��1HWZRUN�7UDLQLQJ
�
�
�
1HWZRUN�7UDLQLQJ
7KH�7UDLQLQJ�2EMHFWLYH
5HJUHVVLRQ��6R�IDU��ZH�KDYH�YLHZHG�QHXUDO�QHWZRUNV�DV�D�JHQHUDO�FODVV�RI�SDUDPHWULF�QRQOLQHDU�IXQFWLRQV
IURP�D�YHFWRU� �RI�LQSXW�YDULDEOHV�WR�D�YHFWRU� �RI�RXWSXW�YDULDEOHV��$�VLPSOH�DSSURDFK�WR�WKH�SUREOHP�RI
GHWHUPLQLQJ�WKH�QHWZRUN�SDUDPHWHUV�LV�WR�PDNH�DQ�DQDORJ\�ZLWK�WKH�GLVFXVVLRQ�RI�SRO\QRPLDO�FXUYH�fWWLQJ
LQ�0RGXOH����DQG�WKHUHIRUH�WR�PLQLPL]H�D�VXP�RI�VTXDUHV�HUURU�IXQFWLRQ��*LYHQ�D�WUDLQLQJ�VHW�FRPSULVLQJ�D
VHW�RI�LQSXW�YHFWRUV� ��ZKHUH� �WRJHWKHU�ZLWK�D�FRUUHVSRQGLQJ�VHW�RI�WDUJHW�YHFWRUV
��ZH�PLQLPL]H�WKH�HUURU�IXQFWLRQ�
:H�FDQ�PRWLYDWH�WKLV�HUURU�IXQFWLRQ�XVLQJ�D�SUREDELOLVWLF�LQWHUSUHWDWLRQ�RI�WKH�QHWZRUN�RXWSXWV�
3DUWLFXODUO\��OHW
V�DVVXPH�WKDW�WKH�WDUJHW�LV�GLVWULEXWHG�DFFRUGLQJ�WR�WKH�IROORZLQJ�*DXVVLDQ�GLVWULEXWLRQ�
ZKHUH� �LV�WKH�H\H��WKH�LGHQWLW\��FRYDULDQFH�PDWUL[��7KH�ORJ�OLNHOLKRRG�RI�WKH�GDWD��WKHQ��LV�
6R�PD[LPLVLQJ�WKH�ORJ�OLNHOLKRRG�IXQFWLRQ� �LV�HTXLYDOHQW�WR�PLQLQJ�WKH�HUURU�IXQFWLRQ� ��7KH
SUREDELOLVWLF�LQWHUSUHWDWLRQ�SURYLGHV�XV�ZLWK�D�FOHDUHU�PRWLYDWLRQ�ERWK�IRU�WKH�FKRLFH�RI�RXWSXW�XQLW
QRQOLQHDULW\�DQG�WKH�FKRLFH�RI�HUURU�IXQFWLRQ�
%LQDU\�&ODVVLcFDWLRQ��1RZ�FRQVLGHU�WKH�FDVH�RI�ELQDU\�FODVVLfFDWLRQ�LQ�ZKLFK�ZH�KDYH�D�VLQJOH�WDUJHW
YDULDEOH� �VXFK�WKDW� �GHQRWHV�FODVV� �DQG� �GHQRWHV�FODVV� ��:H�FRQVLGHU�D�QHWZRUN
KDYLQJ�D�VLQJOH�RXWSXW�ZKRVH�DFWLYDWLRQ�IXQFWLRQ�LV�D�ORJLVWLF�VLJPRLG� ��:H�FDQ�WKHQ�LQWHUSUHW
WKH�QHWZRUN�RXWSXW� �DV�WKH�FRQGLWLRQDO�SUREDELOLW\� ��ZLWK� ��7KH
FRQGLWLRQDO�SUREDELOLW\�RI�D�WUDLQLQJ�LQSXW�WDUJHW�SDLU� �LV�WKHQ
��1HWZRUN�7UDLQLQJ
�
,I�ZH�FRQVLGHU�D�WUDLQLQJ�VHW�RI�LQGHSHQGHQW�REVHUYDWLRQV��WKHQ�WKH�HUURU�IXQFWLRQ��ZKLFK�LV�JLYHQ�E\�WKH
QHJDWLYH�ORJ�OLNHOLKRRG��LV�WKHQ�D�FURVV�HQWURS\�HUURU�IXQFWLRQ�RI�WKH�IRUP
0XOWLFODVV�&ODVVLcFDWLRQ��)LQDOO\��ZH�FRQVLGHU�WKH�VWDQGDUG�PXOWLFODVV�FODVVLfFDWLRQ�SUREOHP�LQ�ZKLFK
HDFK�LQSXW�LV�DVVLJQHG�WR�RQH�RI� �PXWXDOO\�H[FOXVLYH�FODVVHV��7KH�ELQDU\�WDUJHW�YDULDEOHV�
KDYH�D���RI� �FRGLQJ�VFKHPH�LQGLFDWLQJ�WKH�FODVV��DQG�WKH�QHWZRUN�RXWSXWV�DUH�LQWHUSUHWHG�DV
��OHDGLQJ�WR�WKH�IROORZLQJ�HUURU�IXQFWLRQ
,Q�WKLV�FDVH��WKH�RXWSXW�XQLW�DFWLYDWLRQ�IXQFWLRQ�LV�JLYHQ�E\�WKH�VRIWPD[�IXQFWLRQ�
ZKLFK�VDWLVfHV� �DQG� ��5HFDOO�WKDW� �LV�WKH�WRWDO�ZHLJKWHG�VXP�RI�LQSXWV�WR
WKH� �WK�QHXURQH�RI�WKH�ODVW�OD\HU� �
6XPPDU\��7KHUH�LV�D�QDWXUDO�FKRLFH�RI�ERWK�RXWSXW�XQLW�DFWLYDWLRQ�IXQFWLRQ�DQG�PDWFKLQJ�HUURU�IXQFWLRQ�
DFFRUGLQJ�WR�WKH�W\SH�RI�SUREOHP�EHLQJ�VROYHG��)RU�UHJUHVVLRQ�ZH�XVH�OLQHDU�RXWSXWV�DQG�D�VXP�RI�VTXDUHV
HUURU��IRU�ELQDU\�FODVVLfFDWLRQV�ZH�XVH�WKH�VLJPRLG�RXWSXWV�DQG�D�FURVV�HQWURS\�HUURU�IXQFWLRQ��DQG�IRU
PXOWLFODVV�FODVVLfFDWLRQ�ZH�XVH�VRIWPD[�RXWSXWV�ZLWK�WKH�FRUUHVSRQGLQJ�PXOWLFODVV�FURVV�HQWURS\�HUURU
IXQFWLRQ��)RU�FODVVLfFDWLRQ�SUREOHPV�LQYROYLQJ�WZR�FODVVHV��ZH�FDQ�XVH�D�VLQJOH�ORJLVWLF�VLJPRLG�RXWSXW��RU
DOWHUQDWLYHO\�ZH�FDQ�XVH�D�QHWZRUN�ZLWK�WZR�RXWSXWV�KDYLQJ�D�VRIWPD[�RXWSXW�DFWLYDWLRQ�IXQFWLRQ�
3DUDPHWHU�2SWLPLVDWLRQ
7KH�(UURU�6XUIDFH��:H�WXUQ�QH[W�WR�WKH�WDVN�RI�fQGLQJ�D�ZHLJKW�YHFWRU� �ZKLFK�PLQLPL]HV�WKH�FKRVHQ
HUURU�IXQFWLRQ� ��$W�WKLV�SRLQW��LW�LV�XVHIXO�WR�KDYH�D�JHRPHWULFDO�SLFWXUH�RI�WKH�HUURU�IXQFWLRQ��ZKLFK
ZH�FDQ�YLHZ�DV�D�VXUIDFH�VLWWLQJ�RYHU�ZHLJKW�VSDFH�DV�VKRZQ�LQ�)LJXUH�������
��1HWZRUN�7UDLQLQJ
�
)LJXUH��������*HRPHWULFDO�YLHZ�RI�WKH�HUURU�IXQFWLRQ��$�ORFDO�DQG�WKH�JOREDO�PLQLPXPV�DUH
PDUNHG�
1RWH�LQ�)LJXUH��������WKDW�WKH�HUURU�IXQFWLRQ�LV�D�QRQOLQHDU�DQG�QRQ�FRQYH[�IXQFWLRQ�RI�WKH�ZHLJKWV�ZLWK
ORWV�RI�ORFDO�RSWLPD��)XUWKHUPRUH��DV�SUHYLRXV�PRGXOHV��ZH�UHVRUW�WR�WKH��VWRFKDVWLF��JUDGLHQW�GHVFHQW
DOJRULWKP��DV�WKHUH�LV�QR�KRSH�WR�fQG�DQ�DQDO\WLFDO�VROXWLRQ�WR�WKH�RSWLPLVDWLRQ�SUREOHP�
7KH�*UDGLHQW�’HVFHQW�$OJRULWKP��,Q�WKH�UHVW�RI�WKLV�FKDSWHU��ZH�IRFXV�RQ�PLQLPLVLQJ�WKH�HUURU�IXQFWLRQ
IRU�WKH�UHJUHVVLRQ�SUREOHP�EXW�WKH�GLVFXVVLRQ�FDQ�EH�HDVLO\�DSSOLHG�WR�WKH�FODVVLfFDWLRQ�SUREOHPV��/HW
V
GHQRWH�WKH�FRVW�IXQFWLRQ�WR�PLQLPLVH�IRU�WKH�UHJUHVVLRQ�SUREOHP�E\
7KH�fUVW�WHUP�LQ�WKH�WKH�DYHUDJH�VXP�RI�VTXDUHV�HUURU�WHUP��7KH�VHFRQG�WHUP�LV�WKH� �UHJXODULVDWLRQ
WHUP��DOVR�FDOOHG�D�ZHLJKW�GHFD\�WHUP��WKDW�WHQGV�WR�GHFUHDVH�WKH�PDJQLWXGH�RI�WKH�ZHLJKWV��DQG�KHOSV
SUHYHQW�RYHUfWWLQJ��8VXDOO\�ZHLJKW�GHFD\�LV�QRW�DSSOLHG�WR�WKH�ELDV�WHUPV� ��DV�UHgHFWHG�LQ�RXU
GHfQLWLRQ�IRU� ��7KH�ZHLJKW�GHFD\�SDUDPHWHU� �FRQWUROV�WKH�UHODWLYH�LPSRUWDQFH�RI�WKH�WZR�WHUPV�
��1HWZRUN�7UDLQLQJ
��
7R�XVH�JUDGLHQW�GHVFHQW�DOJRULWKP�WR�WUDLQ�RXU�QHXUDO�QHWZRUN��ZH�QHHG�WR�LQLWLDOLVH�HDFK�SDUDPHWHU�
DQG�HDFK� �WR�D�VPDOO�UDQGRP�YDOXH�QHDU�]HUR��VD\�DFFRUGLQJ�WR�D� ��GLVWULEXWLRQ�IRU�VRPH
VPDOO� ��VD\��������DQG�WKHQ�DSSO\�DQ�RSWLPL]DWLRQ�DOJRULWKP�VXFK�DV��VWRFKDVWLF��JUDGLHQW�GHVFHQW��6LQFH
�LV�D�QRQ�FRQYH[�IXQFWLRQ��JUDGLHQW�GHVFHQW�LV�VXVFHSWLEOH�WR�ORFDO�RSWLPD��KRZHYHU��LQ�SUDFWLFH
JUDGLHQW�GHVFHQW�XVXDOO\�ZRUNV�IDLUO\�ZHOO��)LQDOO\��QRWH�WKDW�LW�LV�LPSRUWDQW�WR�LQLWLDOL]H�WKH�SDUDPHWHUV
UDQGRPO\��UDWKHU�WKDQ�WR�DOO��
V��,I�DOO�WKH�SDUDPHWHUV�VWDUW�Re�DW�LGHQWLFDO�YDOXHV��WKHQ�DOO�WKH�KLGGHQ�OD\HU
XQLWV�ZLOO�HQG�XS�OHDUQLQJ�WKH�VDPH�IXQFWLRQ�RI�WKH�LQSXW��PRUH�IRUPDOO\�� �ZLOO�EH�WKH�VDPH�IRU�DOO
YDOXHV�RI� ��VR�WKDW� �IRU�DQ\�LQSXW� ���7KH�UDQGRP�LQLWLDOL]DWLRQ�VHUYHV�WKH
SXUSRVH�RI�V\PPHWU\�EUHDNLQJ�
2QH�LWHUDWLRQ�RI�JUDGLHQW�GHVFHQW�XSGDWHV�WKH�SDUDPHWHUV�DV�IROORZV�
ZKHUH� �LV�WKH�OHDUQLQJ�UDWH��7KH�NH\�VWHS�LV�FRPSXWLQJ�WKH�SDUWLDO�GHULYDWLYHV�DERYH��:H�ZLOO�QRZ
GHVFULEH�WKH�EDFNSURSDJDWLRQ�DOJRULWKP��ZKLFK�JLYHV�DQ�HhFLHQW�ZD\�WR�FRPSXWH�WKHVH�SDUWLDO
GHULYDWLYHV�
7KH�%DFNSURSDJDWLRQ�$OJRULWKP
*UDGLHQW�RI�WKH�7UDLQLQJ�2EMHFWLYH��/HW
V� ��:H�fUVW�GHVFULEH�KRZ
EDFNSURSDJDWLRQ�FDQ�EH�XVHG�WR�FRPSXWH� �DQG� ��WKDW�LV�WKH
SDUWLDO�GHULYDWLYHV�IRU�WKH�FRQWULEXWLRQ�RI�RQH�WUDLQLQJ�GDWD�SRLQW�WR�WKH�WUDLQLQJ�REMHFWLYH��2QFH�ZH�FDQ
FRPSXWH�WKHVH��ZH�VHH�WKDW�WKH�GHULYDWLYH�RI�WKH�RYHUDOO�FRVW�IXQFWLRQ� �FDQ�EH�FRPSXWHG�DV�
*UDGLHQW�RI�D�7UDLQLQJ�’DWXP��7KH�LQWXLWLRQ�RI�WKH�EDFNSURSDJDWLRQ�DOJRULWKP�WR�FRPSXWH�WKH�JUDGLHQW
LV�DV�IROORZV��*LYHQ�D�WUDLQLQJ�GDWXP� ��ZH�ZLOO�fUVW�UXQ�D�IRUZDUG�SDVV�WR�FRPSXWH�DOO�WKH�DFWLYDWLRQV
��1HWZRUN�7UDLQLQJ
��
WKURXJKRXW�WKH�QHWZRUN��LQFOXGLQJ�WKH�RXWSXW�YDOXH�RI�WKH�QHWZRUN� ��7KHQ��IRU�HDFK�QRGH� �LQ�OD\HU
��ZH�ZRXOG�OLNH�WR�FRPSXWH�DQ�HUURU�WHUP� �WKDW�PHDVXUHV�KRZ�PXFK�WKDW�QRGH�ZDV�UHVSRQVLEOH�IRU
DQ\�HUURUV�LQ�WKH�RXWSXW��)RU�DQ�RXWSXW�QRGH��ZH�FDQ�GLUHFWO\�PHDVXUH�WKH�GLeHUHQFH�EHWZHHQ�WKH
QHWZRUN
V�DFWLYDWLRQ�DQG�WKH�WUXH�WDUJHW�YDOXH��DQG�XVH�WKDW�WR�GHfQH� ��ZKHUH�OD\HU� �LV�WKH�RXWSXW
OD\HU���+RZ�DERXW�KLGGHQ�XQLWV”�)RU�WKRVH��ZH�ZLOO�FRPSXWH� �EDVHG�RQ�D�ZHLJKWHG�DYHUDJH�RI�WKH�HUURU
WHUPV�RI�WKH�QRGHV�WKDW�XVHV� �DV�DQ�LQSXW�
7KH�%DFNSURSDJDWLRQ�$OJRULWKP��0RUH�VSHFLfFDOO\��KHUH�LV�WKH�EDFNSURSDJDWLRQ�DOJRULWKP�
3HUIRUP�D�IHHGIRUZDUG�SDVV��FRPSXWLQJ�WKH�DFWLYDWLRQV�IRU�OD\HUV���
)RU�HDFK�RXWSXW�XQLW� �LQ�OD\HU� ��WKH�RXWSXW�OD\HU���VHW��
)RU���
)RU�HDFK�QRGH� �LQ�OD\HU�
6HW�
&RPSXWH�WKH�GHVLUHG�SDUWLDO�GHULYDWLYHV�DV�IROORZV���
)LQDOO\��ZH�FDQ�DOVR�UH�ZULWH�WKH�DOJRULWKP�XVLQJ�PDWUL[�YHFWRULDO�QRWDWLRQ�
3HUIRUP�D�IHHGIRUZDUG�SDVV��FRPSXWLQJ�WKH�DFWLYDWLRQV�IRU�OD\HUV���
)RU�HDFK�RXWSXW�XQLW� �LQ�OD\HU� ��WKH�RXWSXW�OD\HU���VHW��
)RU���
)RU�HDFK�QRGH� �LQ�OD\HU�
6HW�
&RPSXWH�WKH�GHVLUHG�SDUWLDO�JUDGLHQWV�DV�IROORZV���
ZKHUH� �GHQRWHV�WKH�HOHPHQW�ZLVH��L�H��+DGDPDUG��PXOWLSOLFDWLRQ�EHWZHHQ�WZR�YHFWRUV�� �LI
DQG�RQO\�LI� �
��1HWZRUN�7UDLQLQJ
��
3XWWLQJ�LW�$OO�7RJHWKHU��:H�DUH�QRZ�UHDG\�WR�GHVFULEH�WKH�IXOO�JUDGLHQW�GHVFHQW�DOJRULWKP��,Q�WKH
SVHXGR�FRGH�EHORZ�� �LV�D�PDWUL[��RI�WKH�VDPH�GLPHQVLRQ�DV� ���DQG� �LV�D�YHFWRU��RI
WKH�VDPH�GLPHQVLRQ�DV� ���1RWH�WKDW�LQ�WKLV�QRWDWLRQ�� �LV�D�PDWUL[��DQG�LQ�SDUWLFXODU�LW�LVQ
W��
WLPHV� ��
,QLWLDOLVH�UDQGRPO\�WKH�SDUDPHWHUV�RI�WKH�QHWZRUN� �DQG� �IRU�DOO���
:KLOH�D�VWRSSLQJ�FRQGLWLRQ�LV�QRW�PHW�GR���
6HW� �DQG� �IRU�DOO�
)RU� �GR
8VH�EDFN�SURSDJDWLRQ�WR�FRPSXWH� �DQG
6HW�
6HW�
8SGDWH�WKH�SDUDPHWHUV�� �DQG
7KH�DERYH�DOJRULWKP�LV�WKH�EDWFK�JUDGLHQW�GHVFHQW�DOJRULWKP��WKH�SDUDPHWHUV�DUH�XSGDWHG�RQFH�DIWHU�WKH
JUDGLHQW�RI�WKH�REMHFWLYH�IXQFWLRQ�LV�FRPSXWHG�RYHU�WKH�ZKROH�WUDLQLQJ�GDWDVHW��:H�FDQ�PRGLI\�WKH�LW�WR
WKH�VWRFKDVWLF�JUDGLHQW�GHVFHQW�DOJRULWKP�ZKHUH�WKH�SDUDPHWHUV�DUH�XSGDWHG�LPPHGLDWHO\�DIWHU�WKH
JUDGLHQW�RI�WKH�REMHFWLYH�IXQFWLRQ�LV�FRPSXWHG�IRU�HDFK�LQGLYLGXDO�WUDLQLQJ�GDWXP�LQ�WKH�GDWDVHW��7KHUH�DUH
D�ORW�RI�VWXGLHV�LQYHVWLJDWLQJ�WKH�FRQYHUJHQFH�EHKDYLRXU�RI�WKHVH�WZR�gDYRXUV�RI�WKH�JUDGLHQW�GHVFHQW
DOJRULWKP��OHDQLQJ�WRZDUGV�WKH�VXSHULRULW\�RI�WKH�VWRFKDVWLF�JUDGLHQW�GHVFHQW��SDUWLFXODUO\�IRU�ELJ�GDWD��
��5HJXODULVDWLRQ
��
�
�
5HJXODULVDWLRQ
5HJXODULVDWLRQ
7KH�QXPEHU�RI�LQSXW�DQG�RXWSXWV�XQLWV�LQ�D�QHXUDO�QHWZRUN�LV�JHQHUDOO\�GHWHUPLQHG�E\�WKH�GLPHQVLRQDOLW\
RI�WKH�GDWD�VHW��ZKHUHDV�WKH�QXPEHU� �RI�KLGGHQ�XQLWV�LV�D�IUHH�SDUDPHWHU�WKDW�FDQ�EH�DGMXVWHG�WR�JLYH
WKH�EHVW�SUHGLFWLYH�SHUIRUPDQFH��1RWH�WKDW� �FRQWUROV�WKH�QXPEHU�RI�SDUDPHWHUV��ZHLJKWV�DQG�ELDVHV��LQ
WKH�QHWZRUN��DQG�VR�ZH�PLJKW�H[SHFW�WKDW�LQ�D�PD[LPXP�OLNHOLKRRG�VHWWLQJ�WKHUH�ZLOO�EH�DQ�RSWLPXP�YDOXH
RI� �WKDW�JLYHV�WKH�EHVW�JHQHUDOL]DWLRQ�SHUIRUPDQFH��FRUUHVSRQGLQJ�WR�WKH�RSWLPXP�EDODQFH�EHWZHHQ
XQGHU�fWWLQJ�DQG�RYHU�fWWLQJ��)LJXUH��������VKRZV�DQ�H[DPSOH�RI�WKH�HeHFW�RI�GLeHUHQW�YDOXHV�RI� �IRU
WKH�VLQXVRLGDO�UHJUHVVLRQ�SUREOHP�
)LJXUH��������([DPSOHV�RI�WZR�OD\HU�QHWZRUNV�WUDLQHG�RQ����GDWD�SRLQWV�GUDZQ�IURP�WKH�VLQXVRLGDO�GDWD�VHW��7KH
JUDSKV�VKRZ�WKH�UHVXOW�RI�cWWLQJ�QHWZRUNV�KDYLQJ�0� ������DQG����KLGGHQ�XQLWV��UHVSHFWLYHO\��E\�PLQLPL]LQJ�D�VXP�RI�
VTXDUHV�HUURU�IXQFWLRQ�XVLQJ�D�VFDOHG�FRQMXJDWH�JUDGLHQW�DOJRULWKP�
7KH�JHQHUDOL]DWLRQ�HUURU��KRZHYHU��LV�QRW�D�VLPSOH�IXQFWLRQ�RI� �GXH�WR�WKH�SUHVHQFH�RI�ORFDO�PLQLPD�LQ
WKH�HUURU�IXQFWLRQ��DV�LOOXVWUDWHG�LQ�)LJXUH��������+HUH�ZH�VHH�WKH�HeHFW�RI�FKRRVLQJ�PXOWLSOH�UDQGRP
LQLWLDOL]DWLRQV�IRU�WKH�ZHLJKW�YHFWRU�IRU�D�UDQJH�RI�YDOXHV�RI� ��7KH�RYHUDOO�EHVW�YDOLGDWLRQ�VHW
SHUIRUPDQFH�LQ�WKLV�FDVH�RFFXUUHG�IRU�D�SDUWLFXODU�VROXWLRQ�KDYLQJ� ��,Q�SUDFWLFH��RQH�DSSURDFK�WR
FKRRVLQJ� �LV�LQ�IDFW�WR�SORW�D�JUDSK�RI�WKH�NLQG�VKRZQ�LQ�)LJXUH��������DQG�WKHQ�WR�FKRRVH�WKH�VSHFLfF
VROXWLRQ�KDYLQJ�WKH�VPDOOHVW�YDOLGDWLRQ�VHW�HUURU�
��5HJXODULVDWLRQ
��
)LJXUH��������3ORW�RI�WKH�VXP�RI�VTXDUHV�WHVW�VHW�HUURU�IRU�WKH�SRO\QRPLDO�GDWD�VHW�YHUVXV�WKH�QXPEHU�RI�KLGGHQ�XQLWV�LQ
WKH�QHWZRUN��ZLWK����UDQGRP�VWDUWV�IRU�HDFK�QHWZRUN�VL]H��VKRZLQJ�WKH�HbHFW�RI�ORFDO�PLQLPD��)RU�HDFK�QHZ�VWDUW��WKH
ZHLJKW�YHFWRU�ZDV�LQLWLDOL]HG�E\�VDPSOLQJ�IURP�DQ�LVRWURSLF�*DXVVLDQ�GLVWULEXWLRQ�KDYLQJ�D�PHDQ�RI�]HUR�DQG�D
YDULDQFH�RI����
:HLJKW�’HFD\��7KHUH�DUH��KRZHYHU��RWKHU�ZD\V�WR�FRQWURO�WKH�FRPSOH[LW\�RI�D�QHXUDO�QHWZRUN�PRGHO�LQ
RUGHU�WR�DYRLG�RYHU�fWWLQJ��)URP�RXU�GLVFXVVLRQ�RI�SRO\QRPLDO�FXUYH�fWWLQJ�LQ�0RGXOH����ZH�VHH�WKDW�DQ
DOWHUQDWLYH�DSSURDFK�LV�WR�FKRRVH�D�UHODWLYHO\�ODUJH�YDOXH�IRU� �DQG�WKHQ�WR�FRQWURO�FRPSOH[LW\�E\�WKH
DGGLWLRQ�RI�D�UHJXODUL]DWLRQ�WHUP�WR�WKH�HUURU�IXQFWLRQ��7KH�VLPSOHVW�UHJXODUL]HU�LV�WKH�TXDGUDWLF��DND
ZHLJKW�GHFD\���JLYLQJ�D�UHJXODULVHG�HUURU�IXQFWLRQ�DV�ZH�VDZ�LQ�WKH�SUHYLRXV�&KDSWHU��7KH�HeHFWLYH�PRGHO
FRPSOH[LW\�LV�WKHQ�GHWHUPLQHG�E\�WKH�FKRLFH�RI�WKH�UHJXODUL]DWLRQ�FRHhFLHQW� �
(DUO\�6WRSSLQJ��$Q�DOWHUQDWLYH�WR�UHJXODULVDWLRQ�DV�D�ZD\�RI�FRQWUROOLQJ�WKH�HeHFWLYH�FRPSOH[LW\�RI�D
QHWZRUN�LV�WKH�SURFHGXUH�RI�HDUO\�VWRSSLQJ��7KH�WUDLQLQJ�RI�QRQOLQHDU�QHWZRUN�PRGHOV�FRUUHVSRQGV�WR�DQ
LWHUDWLYH�UHGXFWLRQ�RI�WKH�HUURU�IXQFWLRQ�GHfQHG�ZLWK�UHVSHFW�WR�D�VHW�RI�WUDLQLQJ�GDWD��)RU�PDQ\�RI�WKH
RSWLPL]DWLRQ�DOJRULWKPV�XVHG�IRU�QHWZRUN�WUDLQLQJ��VXFK�DV�EDWFK�JUDGLHQW�GHVFHQW��WKH�HUURU�LV�D
QRQLQFUHDVLQJ�IXQFWLRQ�RI�WKH�LWHUDWLRQ�LQGH[��+RZHYHU��WKH�HUURU�PHDVXUHG�ZLWK�UHVSHFW�WR�LQGHSHQGHQW
GDWD��JHQHUDOO\�FDOOHG�D�YDOLGDWLRQ�VHW��RIWHQ�VKRZV�D�GHFUHDVH�DW�fUVW��IROORZHG�E\�DQ�LQFUHDVH�DV�WKH
QHWZRUN�VWDUWV�WR�RYHU�fW��7UDLQLQJ�FDQ�WKHUHIRUH�EH�VWRSSHG�DW�WKH�SRLQW�RI�VPDOOHVW�HUURU�ZLWK�UHVSHFW�WR
WKH�YDOLGDWLRQ�GDWD�VHW��DV�LQGLFDWHG�LQ�)LJXUH��������LQ�RUGHU�WR�REWDLQ�D�QHWZRUN�KDYLQJ�JRRG
JHQHUDOL]DWLRQ�SHUIRUPDQFH�
��5HJXODULVDWLRQ
��
)LJXUH���������$Q�LOOXVWUDWLRQ�RI�WKH�EHKDYLRXU�RI�WUDLQLQJ�VHW�HUURU��OHIW��DQG�YDOLGDWLRQ�VHW�HUURU��ULJKW��GXULQJ�D�W\SLFDO
WUDLQLQJ�VHVVLRQ��DV�D�IXQFWLRQ�RI�WKH�LWHUDWLRQ�VWHS��IRU�WKH�VLQXVRLGDO�GDWD�VHW��7KH�JRDO�RI�DFKLHYLQJ�WKH�EHVW
JHQHUDOL]DWLRQ�SHUIRUPDQFH�VXJJHVWV�WKDW�WUDLQLQJ�VKRXOG�EH�VWRSSHG�DW�WKH�SRLQW�VKRZQ�E\�WKH�YHUWLFDO�GDVKHG�OLQHV�
FRUUHVSRQGLQJ�WR�WKH�PLQLPXP�RI�WKH�YDOLGDWLRQ�VHW�HUURU�
7KH�EHKDYLRXU�RI�WKH�QHWZRUN�LQ�WKLV�FDVH�LV�VRPHWLPHV�H[SODLQHG�TXDOLWDWLYHO\�LQ�WHUPV�RI�WKH�HeHFWLYH
QXPEHU�RI�GHJUHHV�RI�IUHHGRP�LQ�WKH�QHWZRUN��LQ�ZKLFK�WKLV�QXPEHU�VWDUWV�RXW�VPDOO�DQG�WKHQ�WR�JURZV
GXULQJ�WKH�WUDLQLQJ�SURFHVV��FRUUHVSRQGLQJ�WR�D�VWHDG\�LQFUHDVH�LQ�WKH�HeHFWLYH�FRPSOH[LW\�RI�WKH�PRGHO�
+DOWLQJ�WUDLQLQJ�EHIRUH�D�PLQLPXP�RI�WKH�WUDLQLQJ�HUURU�KDV�EHHQ�UHDFKHG�WKHQ�UHSUHVHQWV�D�ZD\�RI
OLPLWLQJ�WKH�HeHFWLYH�QHWZRUN�FRPSOH[LW\�
,Q�WKH�FDVH�RI�D�TXDGUDWLF�HUURU�IXQFWLRQ��L�H��WKH�UHJUHVVLRQ�SUREOHP���ZH�FDQ�YHULI\�WKLV�LQVLJKW��DQG�VKRZ
WKDW�HDUO\�VWRSSLQJ�VKRXOG�H[KLELW�VLPLODU�EHKDYLRXU�WR�UHJXODUL]DWLRQ�XVLQJ�D�VLPSOH�ZHLJKW�GHFD\�WHUP�
7KLV�FDQ�EH�XQGHUVWRRG�IURP�)LJXUH��������,I��LQ�WKH�DEVHQFH�RI�ZHLJKW�GHFD\��WKH�ZHLJKW�YHFWRU�VWDUWV�DW
WKH�RULJLQ�DQG�SURFHHGV�GXULQJ�WUDLQLQJ�DORQJ�D�SDWK�WKDW�IROORZV�WKH�ORFDO�QHJDWLYH�JUDGLHQW�YHFWRU��WKHQ
WKH�ZHLJKW�YHFWRU�ZLOO�PRYH�LQLWLDOO\�SDUDOOHO�WR�WKH� �D[LV�WKURXJK�D�SRLQW�FRUUHVSRQGLQJ�URXJKO\�WR�
DQG�WKHQ�PRYH�WRZDUGV�WKH�PLQLPXP�RI�WKH�HUURU�IXQFWLRQ� ��6WRSSLQJ�DW�D�SRLQW�QHDU� �LV�WKHUHIRUH
VLPLODU�WR�ZHLJKW�GHFD\��7KH�UHODWLRQVKLS�EHWZHHQ�HDUO\�VWRSSLQJ�DQG�ZHLJKW�GHFD\�FDQ�EH�PDGH
TXDQWLWDWLYH��WKHUHE\�VKRZLQJ�WKDW�WKH�TXDQWLW\� ��ZKHUH� �LV�WKH�LWHUDWLRQ�LQGH[��DQG� �LV�WKH�OHDUQLQJ
UDWH�SDUDPHWHU��SOD\V�WKH�UROH�RI�WKH�UHFLSURFDO�RI�WKH�UHJXODUL]DWLRQ�SDUDPHWHU� ��7KH�HeHFWLYH�QXPEHU
RI�SDUDPHWHUV�LQ�WKH�QHWZRUN�WKHUHIRUH�JURZV�GXULQJ�WKH�FRXUVH�RI�WUDLQLQJ�
��5HJXODULVDWLRQ
��
)LJXUH��������$�VFKHPDWLF�LOOXVWUDWLRQ�RI�ZK\�HDUO\�VWRSSLQJ�FDQ�JLYH�VLPLODU�UHVXOWV�WR�ZHLJKW�GHFD\�LQ�WKH�FDVH�RI�D
TXDGUDWLF�HUURU�IXQFWLRQ�
��$FWLYLW\������1HXUDO�1HWZRUN
��
�
�
$FWLYLW\������1HXUDO�1HWZRUN
,Q�WKLV�DFWLYLW\�ZH�LPSOHPHQW�D�EDVLF���OD\HU�IHHG�IRUZDUG�QHXUDO�QHWZRUN�WR�SUDFWLFH�EDFN�SURSDJDWLRQ
DOJRULWKP�7KLV�DFWLYLW\�KHOSV�\RX�WR�FRPSOHWH�$VVLJQPHQW���
3OHDVH�GRZQORDG�WKLV��KWWSV���ZZZ�DOH[DQGULDUHSRVLWRU\�RUJ�ZS�FRQWHQW�XSORDGV����������������$FWLYLW\��]LS��]LS�fOH��ULJKW
FOLFN�DQG�WKHQ�FKRRVH��VDYH�OLQN�DV���WKDW�FRQWDLQV�WKH�GDWDVHW���FVY���5�VFULSW���U���-XS\WHU�QRWHERRN
��LS\QE��DQG�RXWSXW�fOH���KWPO���,I�\RX�KDYH�DFFHVV�WR�D�-XS\WHU�LQVWDQFH��WKH�QRWHERRN��DQG�GDWDVHW��LV
HQRXJK�WR�UXQ�WKH�H[SHULPHQWV��2WKHUZLVH��\RX�PD\�UHDG�WKH�LQVWUXFWLRQV�DQG�GLVFXVVLRQV�IURP�WKH�+70/
fOH�DQG�H[HFXWH�WKH�5�VFULSW�
)RU�GHWDLOHG�GLVFXVVLRQ�DERXW�VHWWLQJ�\RXU�SURJUDPPLQJ�HQYLURQPHQW�XS��SOHDVH�UHIHU�WR�$SSHQGL[�%�
6HWWLQJ�XS�
GDW����GDW>VDPSOH�QURZ�GDW���������@
ZULWH�FVY�[� �GDW��cOH �
��WUDLQB�B�BVPDOO�FVY
��URZ�QDPHV� �)$/6(�
,I�\RX�KDYH�DFFHVV�WR�D�-XS\WHU�LQVWDQFH��WKH�QRWHERRN��DQG�GDWDVHW��LV�HQRXJK�WR�UXQ�WKH�H[SHULPHQWV�
2WKHUZLVH��\RX�PD\�UHDG�WKH�LQVWUXFWLRQV�DQG�GLVFXVVLRQV�IURP�WKH�+70/�fOH�DQG�H[HFXWH�WKH�5�VFULSW��)RU
GHWDLOHG�GLVFXVVLRQ�DERXW�VHWWLQJ�\RXU�SURJUDPPLQJ�HQYLURQPHQW�XS��SOHDVH�UHIHU�WR�$SSHQGL[�%��6HWWLQJ
XS�
�������� ����>@��DQG�VLQFH�ZH�KDYH�����IHDWXUHV��WKLV�UHVXOWV�LQ�D�YHFWRU�RI
>@��A�d��� ���������>@�IHDWXUHV�SHU�H[DPSOH��/HDUQLQJ�D�FODVVLfHU�ZLWK�LQSXWV�KDYLQJ����PLOOLRQ
IHDWXUHV�FDQ�EH�XQZLHOG\��DQG�FDQ�DOVR�EH�SURQH�WR�RYHU�fWWLQJ�
7R�DGGUHVV�WKLV��fUVW�UHFDOO�WKDW�ZH�GHFLGHG�WR�REWDLQ�FRQYROYHG�IHDWXUHV�EHFDXVH�LPDJHV�KDYH�WKH
�VWDWLRQDULW\��SURSHUW\��ZKLFK�LPSOLHV�WKDW�IHDWXUHV�WKDW�DUH�XVHIXO�LQ�RQH�UHJLRQ�DUH�DOVR�OLNHO\�WR�EH
XVHIXO�IRU�RWKHU�UHJLRQV��7KXV��WR�GHVFULEH�D�ODUJH�LPDJH��RQH�QDWXUDO�DSSURDFK�LV�WR�DJJUHJDWH�VWDWLVWLFV
RI�WKHVH�IHDWXUHV�DW�YDULRXV�ORFDWLRQV��)RU�H[DPSOH��RQH�FRXOG�FRPSXWH�WKH�PHDQ��RU�PD[��YDOXH�RI�D
SDUWLFXODU�IHDWXUH�RYHU�D�UHJLRQ�RI�WKH�LPDJH��7KHVH�VXPPDU\�VWDWLVWLFV�DUH�PXFK�ORZHU�LQ�GLPHQVLRQ
�FRPSDUHG�WR�XVLQJ�DOO�RI�WKH�H[WUDFWHG�IHDWXUHV��DQG�FDQ�DOVR�LPSURYH�UHVXOWV��OHVV�RYHU�fWWLQJ���7KLV
DJJUHJDWLRQ�IHDWXUHV�LV�FDOOHG�SRROLQJ��$V�DQ�H[DPSOH��ZH�FDQ�KDYH�PHDQ�SRROLQJ�RU�PD[�SRROLQJ�
GHSHQGLQJ�RQ�WKH�SRROLQJ�RSHUDWLRQ�DSSOLHG�
7KH�IROORZLQJ�LPDJH�VKRZV�KRZ�SRROLQJ�LV�GRQH�RYHU���QRQ�RYHUODSSLQJ�UHJLRQV�RI�WKH�LPDJH�
),*85(�KWWS���XgGO�VWDQIRUG�HGX�WXWRULDO�VXSHUYLVHG�3RROLQJ�
)RUPDOO\��DIWHU�REWDLQLQJ�RXU�FRQYROYHG�IHDWXUHV�DV�GHVFULEHG�HDUOLHU��ZH�GHFLGH�WKH�VL]H�RI�WKH�UHJLRQ��VD\
P�E\�Q�WR�SRRO�RXU�FRQYROYHG�IHDWXUHV�RYHU��7KHQ��ZH�GLYLGH�RXU�FRQYROYHG�IHDWXUHV�LQWR�GLVMRLQW�P�E\�Q
UHJLRQV��DQG�WDNH�WKH�PHDQ��RU�PD[LPXP��IHDWXUH�DFWLYDWLRQ�RYHU�WKHVH�UHJLRQV�WR�REWDLQ�WKH�SRROHG
FRQYROYHG�IHDWXUHV��7KHVH�SRROHG�IHDWXUHV�FDQ�WKHQ�EH�XVHG�IRU�FODVVLfFDWLRQ�
,Q�WKH�QH[W�VHFWLRQ��ZH�IXUWKHU�GHVFULEH�KRZ�WR��SRRO��WKHVH�IHDWXUHV�WRJHWKHU�WR�JHW�HYHQ�EHWWHU�IHDWXUHV
IRU�FODVVLfFDWLRQ�
‘HHS�&RQYROXWLRQDO�1HXUDO�1HWZRUNV
7KH�0RGHO��$�FRQYROXWLRQDO�QHXUDO�QHWZRUN��&11��FRQVLVWV�RI�D�QXPEHU�RI�FRQYROXWLRQDO�DQG�SRROLQJ
OD\HUV�RSWLRQDOO\�IROORZHG�E\�IXOO\�FRQQHFWHG�OD\HUV��7KH�FRQYROXWLRQDO�OD\HU�ZLOO�KDYH� �IHDWXUH�GHWHFWRUV�
DOVR�FDOOHG�fOWHUV�RU�NHUQHOV��ZKHUH�HDFK�IHDWXUH�GHWHFWRU�LV�DSSOLHG�RYHU�D�SDWFK�RI�WKH�LQSXW��(DFK�fOWHU�LV
WKHQ�FRQYROYHG�ZLWK�WKH�LQSXW�WR�SURGXFH�D�IHDWXUH�PDS��DQG�WKHQ�WKH�IHDWXUH�PDS�LV�DJJUHJDWHG�E\�D
��237,21$/��&RQYROXWLRQDO�1HXUDO�1HWZRUNV
��
SRROLQJ�RSHUDWLRQ�VXFK�DV�PD[�SRROLQJ��7KH�FRQYROXWLRQ�SRROLQJ�OD\HUV�FDQ�EH�UHSHDWHG�DQG�SXW�DIDU�HDFK
RWKHU�PXOWLSOH�WLPHV�WR�EXLOG�GHHS�&11�DUFKLWHFWXUHV�
),*85(�KWWS���XgGO�VWDQIRUG�HGX�WXWRULDO�VXSHUYLVHG�&RQYROXWLRQDO1HXUDO1HWZRUN�
&11�7UDLQLQJ��&11�FDQ�EH�WUDLQHG�E\�WKH�EDFNSURSDJDWLRQ�DOJRULWKP�YLD��VWRFKDVWLF��JUDGLHQW�GHVFHQW�
SUH�WUDLQLQJ”
��$SSHQGL[��+�2�/LEUDU\
��
�
�
$SSHQGL[��+�2�/LEUDU\
+�2�/LEUDU\
,QWURGXFWLRQ
+�2�LV�DQ�RSHQ�VRXUFH�OLEUDU\�WKDW�SURYLGHV�ORWV�RI�PDFKLQH�OHDUQLQJ�DOJRULWKPV�ZKLFK�SHUIRUP�HeHFWLYHO\
IDVW��2QH�FDQ�XVH�WKLV�OLEUDU\�XVLQJ�+�2�JUDSKLFDO�LQWHUIDFH��FDOOHG�+�2�)ORZ��RU�FRQQHFW�LWV�5�FRQVROH�WR
DQ�+�2�FOXVWHU�UXQQLQJ�HLWKHU�ORFDOO\�RU�LQ�WKH�FORXG��+HUH��ZH�LQVWDOO�DQ�+�2�FOXVWHU�RQ�RXU�PDFKLQH�DQG
FRQQHFW�RXU�5�QRWHERRN��-XS\WHU��XVH�5(67�$3,V�
,QVWDOODWLRQ
%HIRUH�JRLQJ�IXUWKHU��GRZQORDG�WKH�ODWHVW�YHUVLRQ��KWWS���ZZZ�K�R�DL�GRZQORDG�K�R�FKRRVH��RI�+�2�DQG�XQ]LS�LW�LQ
\RXU�SUHIHUHG�ORFDO�IROGHU��7KHQ��JR�WR�WKDW�IROGHU�DQG�UXQ�MDYD��MDU�K�R�MDU�LQ�\RXU�FRPPDQG
SURPSW�RU�WHUPLQDO��1RZ�\RX�VKRXOG�EH�DEOH�WR�VHH�+�2�)ORZ�DW�\RXU�EURZVHU
KWWS�������������������gRZ�LQGH[�KWPO��)LQDOO\��IROORZ�WKHVH�VWHSV��KWWS���ZZZ�K�R�DL�GRZQORDG�K�R�U��WR�LQVWDOO
+�2�OLEUDU\�LQWR�\RXU�5�6WRGLR�7HUPLQDO�1RWHERRN�
1RWH����PDNH�VXUH�\RXU�+�2�FOXVWHU�DQG�5�OLEUDU\�KDYH�H[DFWO\�WKH�VDPH�YHUVLRQ�QXPEHU�
1RWH����LI�\RX�VHW�VRPH�KWWS�SUR[\��VDYH�\RXU�SUR[\�VHWWLQJ�DV�SUR[\�ROG���
6\V�JHWHQY�
KWWSBSUR[\
��DQG�XQVHW�WKH�SUR[\�YLD�6\V�VHWHQY�
KWWSBSUR[\
��EHIRUH
H[HFXWLQJ�WKH�IROORZLQJ�VWDWHPHQWV��
,I�HYHU\WKLQJ�JRHV�ULJKW��\RX�VKRXOG�EH�DEOH�WR�VHH�WKH�LPSRUWHG�GDWD�ZKHQ�SHUIRUP�OLVWLQJ�RQ�+�2�
��6KRZV�WKH�GDWD�REMHFWV�RQ�WKH�+�2�SODWIRUP
K�R�OV��