(IIHFWVRI0XOWL&RUH3URFHVVRUVRQ6HTXHQWLDO
'LYLGHDQG&RQTXHU$OJRULWKPV
2021 National Computing Colleges Conference (NCCC) | 978-1-7281-6719-0/20/$31.00 ©2021 IEEE | DOI: 10.1109/NCCC49330.2021.9428867
)DKG$$OKDLGDUL
1HWZRUNVDQG&RPPXQLFDWLRQV'HSDUWPHQW&ROOHJHRI
&RPSXWHU6FLHQFHDQG,QIRUPDWLRQ7HFKQRORJ\
,PDP$EGXOUDKPDQ%LQ)DLVDO8QLYHUVLW\
32'DPPDP6DXGL$UDELD
IDDOKLDGDUL#LDXHGXVD
$EVWUDFW²:LWK WKH VSUHDG RI PXOWLFRUH V\VWHPV SDUDOOHO
SURJUDPPLQJ LQFUHDVHG LQ SRSXODULW\ +RZHYHU SDUDOOHOL]LQJ
DOJRULWKPVLQVRPHFDVHV\LHOGQHJDWLYHUHVXOWVGXHWRRYHUKHDG
$GGLWLRQDOO\LPSOHPHQWLQJSDUDOOHODOJRULWKPVLVQRWDOZD\VDQ
HDV\RUDFKLHYDEOHWDVN7KHUHIRUHILQGLQJRXWWRZKDWH[WHQWD
PXOWLFRUH DUFKLWHFWXUH FDQ DLG LQ WKH HQKDQFHPHQW RI WKH
DOJRULWKP¶V VSHHGXS FRXOG EHFRPH H[WUHPHO\ EHQHILFLDO 7KLV
SDSHUVWXGLHVDQGFDOFXODWHVWKHH[HFXWLRQWLPHDQGVSHHGXSRI
WKUHHRIWKHPRVWSRSXODUGLYLGHDQGFRQTXHUDOJRULWKPV 0HUJH
VRUW TXLFN VRUW DQG PDWUL[ PXOWLSOLFDWLRQ WKH FRQGXFWHG
H[SHULPHQWVWHVWHGDJDLQVWYDULRXVDUUD\VL]HV7KHH[SHULPHQWV
WDNHSODFHRQWKUHHGLIIHUHQWPXOWLFRUHPDFKLQHVUDQJLQJIURP
D GXDOFRUH &38 WR D KH[DFRUH &38 7KH REWDLQHG UHVXOWV
FRQFOXGHWKDWVSHHGXSLVGLUHFWO\SURSRUWLRQDOWRWKHQXPEHURI
&38FRUHVVXFKWKDWXVLQJDKH[DFRUH&38LQOLHXRIDGXDO
FRUH &38 FDQ DFKLHYH D VSHHGXS XS WR WZLFH DV IDVW 7KXV
XWLOL]LQJ SRZHUIXO PXOWLFRUH &38¶V FRXOG ULYDO WKH XVH RI
SDUDOOHOLVPRQDVWDQGDUG&38
.H\ZRUGV² 0XOWLFRUH 'LYLGH DQG FRQTXHU 6HTXHQWLDO
6SHHGXSSDUDOOHOLVP
,
,1752'8&7,21
(QKDQFLQJ DOJRULWKP VSHHG LV D JRDO PDQ\ FRPSXWHU
VFLHQWLVWVDLPWRDFKLHYH7KLVKDVEHHQWKHFDVHVLQFHWKHWLPH
RI³7KHIUHHOXQFK´ZDVRYHU>@PHUHO\VSHHGLQJXSWKHFORFN
VSHHGRIDFRPSXWHUSURFHVVRUZDVQRORQJHUDYLDEOHRSWLRQ
WKHUHKDGWREHVRPHRWKHUPHDVXUHVWDNHQLQWRDFWLRQ7KXV
LQWKHILUVWGXDOFRUHSURFHVVRUZDVUHOHDVHG6LQFHWKHQ
SURFHVVRUVKDYHFRQWLQXHGWRHYROYHWRWKHSRLQWWKDWWKHUHLV
QRZDQFRUH&38PDQXIDFWXUHGE\,QWHO>@
$V WKH QHZ HUD RI PXOWLFRUH SURFHVVRUV HPHUJHG WKH
SURFHVVLQJSRZHUKDVLQFUHDVHGH[SRQHQWLDOO\6XEVHTXHQWO\
SDUDOOHOSURJUDPPLQJZDVLQWURGXFHGLQRUGHUWRH[SORLWWKHVH
PXOWLFRUHSURFHVVRUVIXOO\+RZHYHUZKLOHVRPHDOJRULWKPV
DUH FRQVLGHUHG ³HPEDUUDVVLQJO\ SDUDOOHO´ PDQ\ DOJRULWKPV
DUH QRW RSWLPL]HG IRU SDUDOOHOLVP ,Q IDFW IURP D
FRPSXWDWLRQDOSRLQWRIYLHZPRVWUHDOZRUOGSUREOHPVFDQQRW
EHIXOO\SDUDOOHOL]HGDVHDVLO\DVRWKHUV>@
'LYLGH DQG FRQTXHU DOJRULWKPV GLYLGH WKH RULJLQDO
SUREOHPV LQWR VPDOOHU VXESUREOHPV DQG VROYH WKHP
VHSDUDWHO\7KHUHIRUHWKHVHDOJRULWKPVDUHFRPPRQO\NQRZQ
IRUWKHLUHIIHFWLYHSHQDOL]DWLRQ+HQFHWKHQXPHURXVVWXGLHV
DQDO\]LQJWKHVSHHGXSJDLQHGIURPVDLGSDUDOOHODUFKLWHFWXUH
WKDW DUH GLVFXVVHG LQ WKH OLWHUDWXUH 6R LQ RUGHU WR ILQG D
VROXWLRQWRWKHSUREOHPZKHUHSDUDOOHOLVPFDQQRWEHDFKLHYHG
WKLVVWXG\DLPVWRJDLQLQVLJKWLQWRWKHVSHHGXSDFKLHYHGE\
UXQQLQJ D VHTXHQWLDO DOJRULWKP RQ YDULRXV PXOWLFRUH
PDFKLQHV )XUWKHUPRUH WKLV VWXG\ ZLOO XWLOL]H WKH SUHYLRXV
SDUDOOHOL]HG GLYLGH DQG FRQTXHU DOJRULWKPV VWXGLHV DV D
EHQFKPDUN+HQFHWKHFKRVHQGLYLGHDQGFRQTXHUDOJRULWKPV
WKDWZLOOEHWHVWHGLQWKLVSDSHUDUHEDVHGRQWKHPDMRULW\RI
0DLVVD$$O0HWULN
&RPSXWHU6LHQFH'HSDUWPHQW&ROOHJHRI&RPSXWHU6FLHQFHDQG
,QIRUPDWLRQ7HFKQRORJ\
,PDP$EGXOUDKPDQ%LQ)DLVDO8QLYHUVLW\
32'DPPDP6DXGL$UDELD
#LDXHGXVD
SDVW VWXGLHV ZKLFK DUH PHUJH VRUW TXLFN VRUW DQG PDWUL[
PXOWLSOLFDWLRQ
:KLOH WKH FRQWLQXRXV GHPDQG IRU KLJKHU FRPSXWDWLRQDO
SRZHU LV XQGHUVWDQGDEOH WKH SHUIRUPDQFH RI DOJRULWKPV QR
ORQJHU GHSHQGV VROHO\ RQ WKH GHVLJQ DQG VWUXFWXUH RI WKH
DOJRULWKP1RZZLWKWKHXVHRIPXOWLFRUHSURFHVVRUVPDQ\
DOJRULWKPV DUH VWUXFWXUHG WR EH SDUDOOHOL]DEOH +RZHYHU
XQIRUWXQDWHO\LQPDQ\FDVHVHYROYLQJDQDOJRULWKPLQWRLWV
SDUDOOHO HTXLYDOHQW LV QRW DQ HDV\ RU JXDUDQWHHG WDVN 7KXV
KDYLQJWKHRSWLRQRIUXQQLQJDVHTXHQWLDODOJRULWKPHIILFLHQWO\
FDQ EH XVHIXO LQ DLGLQJ SURJUDPPHUV RU GHYHORSHUV LQ
H[SORLWLQJWKHVHPXOWLFRUHSURFHVVRUVZKHQGHFLGLQJZKLFK
KDUGZDUHLVEHVWVXLWHGIRUWKHGHYHORSPHQWRIWKHLUVRIWZDUH
$OWKRXJK WKH WLPH FRPSOH[LW\ RI HDFK RI WKH SURSRVHG
DOJRULWKPV LV DOUHDG\ NQRZQ GHWHUPLQLQJ WKH LPSDFW RI
SRZHUIXOSURFHVVRUVRQWKHVDPHDOJRULWKPFDQEHEHQHILFLDO
LQSUDFWLFH7KHUHIRUHWKHREMHFWLYHRIWKLVSDSHULVWRH[DPLQH
WKHHIIHFWVWKDWFDQEHFDXVHGE\PXOWLFRUHPDFKLQHVZKHQ
UXQQLQJ VHTXHQWLDO GLYLGH DQG FRQTXHU DOJRULWKPV 7KHQ
FRPSDULQJ WKH SHUIRUPDQFHV RI WKHVH PXOWLFRUH SURFHVVRUV
DJDLQVW HDFK RWKHU WR FRQFOXGH WKH HIIHFWLYHQHVV RI WKLV
WHFKQLTXH
7KH VWUXFWXUH RI WKH UHVW RI WKH SDSHU LV DV IROORZV
5HTXLUHGEDFNJURXQGLVSUHVHQWHGLQ6HFWLRQDQG6HFWLRQ
FRYHUV WKH OLWHUDWXUH UHYLHZ RI WKH PRVW UHFHQW VWXGLHV RQ
SDUDOOHOL]HGYVVHTXHQWLDODOJRULWKPV6HFWLRQLOOXVWUDWHVWKH
SURSRVHG PHWKRGRORJ\ RI WHVWLQJ WKH DOJRULWKPV 6HFWLRQ H[DPLQHV WKH UHVXOWV DQG GLVFXVVLRQ RI WKH H[SHULPHQWV
)LQDOO\WKHSDSHUFRQFOXGHVLWVILQGLQJVLQVHFWLRQ
,,
%$&.*5281'
,QWKLVVHFWLRQZHH[SORUHWKUHHRIWKHPRVWSRSXODUGLYLGH
DQG FRQTXHU DOJRULWKPV 0HUJH VRUW TXLFN VRUW DQG PDWUL[
PXOWLSOLFDWLRQ DVEDVLVIRURXUVWXG\
$ 0HUJH6RUW
0HUJH VRUW LV RQH RI WKH PRVW SRSXODU DOJRULWKPV WKDW
IROORZVWKHGLYLGHDQGFRQTXHUSDUDGLJP,WVRUWVDJLYHQDUUD\
E\ SDUWLWLRQLQJ WKH HOHPHQWV LQWR WZR JURXSV EHIRUH
UHFXUVLYHO\VRUWLQJHDFKRIWKHUHVXOWLQJVXEDUUD\VWKHQILQDOO\
LQWHUOHDYLQJWKHWZRVRUWHGOLVWVWRRUGHUWKHHOHPHQWVHQWLUHO\
7KHWLPHFRPSOH[LW\IRUVXFKDOJRULWKPLV2 QOJQ ZKHUHLWLV
DEOHWRDFKLHYHWKLVWLPHFRPSOH[LW\E\UHSHDWLQJWKHGLYLVLRQ
RIHDFKVXEDUUD\XQWLOWKHUHLVRQO\RQHHOHPHQWSHUVXEDUUD\
WKDW LV FRQVHTXHQWO\ LQ LWVHOI VRUWHG 7KHQ WKH DOJRULWKP
PHUJHV WKHVH VRUWHG VXEDUUD\V ZKLOH PDLQWDLQLQJ WKH VRUWHG
SURSHUW\>@>@
% 4XLFN6RUW
6LPLODUWRPHUJHVRUWTXLFNVRUWDOVRIROORZVWKHGLYLGH
DQGFRQTXHUSDUDGLJP,WGRHVVRE\XVLQJZKDWLVNQRZQDV
;;;;;;;;;;;;;;;;;;;,(((
Authorized licensed use limited to: San Francisco State Univ. Downloaded on June 18,2021 at 18:34:16 UTC from IEEE Xplore. Restrictions apply.
SDUWLWLRQLQJ4XLFNVRUWSDUWLWLRQVWKHDUUD\LQWRWZRSDUWVWKDW
DUHQRWDOZD\VHTXDO>@7KHDOJRULWKPGRHVVRE\FKRRVLQJ
ZKDWLVNQRZQDVDSLYRWVRWKDWWKHRQHVHFWLRQRIWKHSDUWLWLRQ
LV UHSUHVHQWDWLYH RI HOHPHQWV WKDW DUH OHVV WKDQ WKH SLYRW
ZKHUHDVWKHRWKHUSDUWFRQWDLQVHOHPHQWVWKDWDUHODUJHUWKDQ
WKHFKRVHQSLYRW$IWHUWKHLQLWLDOSDUWLWLRQRFFXUVDQGWKHDUUD\
LV VSOLW LQWR WZR VHFWLRQV WKH SURFHGXUH LV WKHQ UHSHDWHG RQ
ERWKVLGHVRIWKHSLYRW7KHDOJRULWKPVWRSVWKHSDUWLWLRQLQJ
ZKHQ QR HOHPHQWV DUH OHIW WR SDUWLWLRQ DQG WKH\ DUH DOO
FRUUHFWO\ UHDUUDQJHG DFFRUGLQJO\ >@ 7KH ZRUVWFDVH WLPH
FRPSOH[LW\ RI WKH DOJRULWKP LV 2 Q 1RQHWKHOHVV PDQ\
LPSURYHPHQWVWRWKHDOJRULWKPKDYHEHHQPDGHWRHQVXUHDQ
H[SHFWHGUXQQLQJWLPHRIܱሺ݊ ݊ሻ>@
& 6WUDVVHQ¶VPDWUL[PXOWLSOLFDWLRQ
%HLQJ ZLGHO\ NQRZQ LQ OLQHDU DOJHEUD PDWUL[
PXOWLSOLFDWLRQLVDYDVWO\VWXGLHGSUREOHPLQKLJKSHUIRUPDQFH
FRPSXWDWLRQGXHWRWKHQXPHURXVDSSOLFDWLRQVWKDWLPSOHPHQW
LW>@7KHEDVLFFRQFHSWEHKLQGWKHSUREOHPLVVLPSOHJLYHQ
DQ DUUD\ܣǡ DQG DQ DUUD\ ܤǡ WKDW DUH݊ ൈ ݊ PDWULFHV ZH
KDYH WKH SURGXFW ܥൌ ܣǤ ܤZKHUH ܿǡ ൌ σୀଵ ܽǡ Ǥ ܾǡ IRU
݅ǡ ݆ ൌ ͳǡ ʹǡ ǥ ǡ ݊
7KH 6WUDVVHQ¶V DOJRULWKP SURYLGHV D VROXWLRQ IRU WKLV
SUREOHP UHFXUVLYHO\ LQܱሺ݊ଶǤ଼ଵ ሻWLPH >@ 7KH SVHXGRFRGH
SUHVHQWHGLQ)LJVKRZVWKHVWUXFWXUHRIWKHDOJRULWKP:KLOH
LWPD\VHHPDWILUVWJODQFHWKDWWKHSDUWLWLRQLQJFRGHLQOLQH
ZRXOGUHTXLUHFRS\LQJHDFKHOHPHQWRIWKHDUUD\VLQIDFWWKDW
LV QRW QHFHVVDU\ LI XVLQJ LQGH[ FDOFXODWLRQV LV WDNHQ LQWR
FRQVLGHUDWLRQ>@
' 0XOWLFRUHSURFHVVRUV
0XOWLFRUHSURFHVVRUVDSSHDUHGZKHQ PHUHO\LQFUHDVLQJ
VFDODELOLW\ IRU EHWWHU SHUIRUPDQFH FDPH WR D KDOW 3UHFLVHO\
ZKHQ WKH VSHHG RI D VLQJOH SURFHVVRU FRXOG QR ORQJHU JR
EH\RQG *+] 6LQFH WKDW WLPH WKH QHHG IRU PRUH
FRPSXWDWLRQDOSRZHUNHSWH[FHHGLQJZKLFKUHVXOWHGLQ0XOWL
FRUHSURFHVVRUV>@>@+DYLQJRQO\WZRSURFHVVRUVUXQQLQJRQ
ORZHUIUHTXHQF\SURYHGWRHVWDEOLVKDEHWWHUSHUIRUPDQFHWKDQ
WKDWRIWKHVLQJOHSURFHVVRUZKLFKUXQVRQDKLJKHUIUHTXHQF\
,,, /,7(5$785(5(9,(:
6LQFHWKHGDZQRIPXOWLFRUHSURFHVVRUVFDPHXSRQXVD
ZLGHVSUHDG SURGXFWLRQ RI SDUDOOHOL]HG DOJRULWKPV DQG
SODWIRUPV VXUIDFHG LQ KRSHV RI UHGXFLQJ UXQQLQJ WLPH 7KH
UXQQLQJ WLPH RI DOJRULWKPV KDV DOZD\V EHHQ WKH FRUH LVVXH
VXUURXQGLQJ WKH SHUIRUPDQFH RI WKH DOJRULWKPV ,Q RUGHU WR
EHWWHU DQDO\]H WR ZKDW H[WHQW WKHVH PXOWLFRUH DUFKLWHFWXUHV
FDQDLGLQWKHHQKDQFHPHQWRIDOJRULWKPVPHDVXULQJVSHHGXS
LVSLYRWDOZKHQGHFLGLQJLIDSDUWLFXODUDOJRULWKPLVEHVWXVHG
LQ SDUDOOHO RQ D PXOWLFRUH GHYLFH RU QRW ,Q WKLV VHFWLRQ D
OLWHUDWXUHRIHVVHQWLDOSDVWVWXGLHVLVUHYLHZHG/LVWHGEDVHGRQ
WKH LPSOHPHQWHG DOJRULWKP DIWHU WKDW D VXPPDUL]DWLRQ RI
WKHVH SDSHUV ZLOO EH H[DPLQHG IXUWKHU IRU FRPSDULVRQ
SXUSRVHV
7$%/(,SUHVHQWVDVXPPDU\RIDOOWKHVWXGLHVUHYLHZHG
LQ WKH OLWHUDWXUH ZKHUH LW VXPPDUL]HV WKH WHVWHG DOJRULWKP
QXPEHURIFRUHVWKUHDGVWKHGDWDVL]HDQGWKHPDMRUILQGLQJV
RIWKHH[SHULPHQWV
)LJ3VHXGRFRGHIRU6WUDVVHQ VPDWUL[PXOWLSOLFDWLRQ
8QGHUVWDQGDEO\ WKH PDMRULW\ RI WKH VWXGLHV IRFXVHG RQ
VRUWLQJ DOJRULWKPV 7KLV FDQ EH DWWULEXWHG WR WKHLU VLPSOH
LPSOHPHQWDWLRQDQGUHVXOWVWKDWDUHHDV\WRWUDFNDQGFRPSDUH
$UHFHQWVWXG\>@VKRZVWKHSHUIRUPDQFHRIPHUJHVRUWRQ
ERWKVHTXHQWLDODQGSDUDOOHODOJRULWKPVZLWKDPD[LPXPGDWD
RIWZR PLOOLRQ HOHPHQWV 1DWXUDOO\ WKH VWXG\ VKRZV WKDWRQ
VPDOO GDWD VL]HV WKH VHTXHQWLDO DOJRULWKP SURYLGHV EHWWHU
SHUIRUPDQFH+RZHYHUDVWKHGDWDVL]HLQFUHDVHVLWLVPRUH
HIILFLHQWWRXVHWKHSDUDOOHODOJRULWKP7KHSHUIRUPDQFHZDV
HYDOXDWHGEDVHGRQWKHUXQQLQJWLPHRIWKHDOJRULWKPH[HFXWHG
RQHLJKWFRUHV7KRXJKWKHVWXG\ZDVFRQGXFWHGXVLQJDTXDG
FRUHSURFHVVRUPHDQLQJWKDWH[SHULPHQWV ZHUHEDVHGRQWKH
QXPEHURIWKUHDGVUDWKHUWKDQFRUHV1HYHUWKHOHVVWKHDXWKRUV
ZHQWRQWRFDOFXODWHWKHVFDODELOLW\RIWKHSDUDOOHOLVPZKLFK
RWKHU VWXGLHV QHJOHFW WR PHQWLRQ 7KH VDPH PHUJH VRUW
DOJRULWKP ZDV H[DPLQHG E\ >@ DORQJ ZLWK WKUHH RWKHU
DOJRULWKPV ELWRQLF VRUW UDGL[ VRUW DQG TXLFN VRUW 7KH
H[SHULPHQWVZHUHFRQGXFWHGRQDGXDOFRUHSURFHVVRUDQGWKH
EDVLV RI FRPSDULVRQ ZDV D VLPSOH SDUDOOHO YV VHTXHQWLDO
UXQQLQJ WLPH VKRZLQJ WKDW VHTXHQWLDO DOJRULWKPV SURGXFHG
EHWWHU UXQQLQJ WLPH LQ WHUPV RI VPDOO GDWD DQG YLFH YHUVD
0RUHRYHU LW LV QRWHZRUWK\ WKDW WKHLU WHVW VKRZHG IRU ODUJH
GDWD PHUJH VRUW DORQJ ZLWK ELWRQLF VRUW DUH VXSHULRU ZKHQ
FRPSDUHGWRELWRQLFVRUWRUUDGL[VRUW
6LPLODUUHVXOWVZHUHDFKLHYHGE\>@ZKHUHWKHDXWKRUV
DVVHVVHGERWKPHUJHVRUWDQGTXLFNVRUWRQDGDWDVHWRIIRXU
WKRXVDQGHOHPHQWVZKLFKLVDODUJHUVL]HWKDQWKHVL]HWHVWHG
LQ >@ 0XVWDID DQG :DVHHP >@ FDPH WR WKH VDPH
FRQFOXVLRQZKHQWKH\WHVWHGERWKWKHPHUJHVRUWDQG)OR\G¶V
DOJRULWKP RQ WKH 2SHQ03 SODWIRUP 2Q D TXDGFRUH WKHLU
UHVXOWV VKRZHG WKDWWKH VSHHGXS EHWZHHQ WKH VHTXHQWLDODQG
SDUDOOHODOJRULWKPVLVDOPRVWWZLFHDVIDVW7KH\DOVRQRWLFHGD
OLQHDU VSHHGXS LQ WKH SDUDOOHO UXQ $QRWKHU VWXG\ >@
FRPSDUHG WKH SHUIRUPDQFH RI PHUJH VRUW TXLFN VRUW DQG
FRXQWLQJ VRUW 7KH FRPSDULVRQ ZDV PDGH XVLQJ D SRZHUIXO
&38WKDWSDUDOOHOL]HGWKHDOJRULWKPVLQWKUHDGVWKDWUHDFKHG
XS WR WKUHDGV 7KH GDWD VL]H XVHG LQ WKLV SDSHU ZDV
SDUDPRXQWZLWKWKHGDWDUHDFKLQJRYHURQHELOOLRQHOHPHQWV
)XUWKHUPRUHLQRUGHUWRNQRZZKDWWKHOLPLWVZHUHIRUHDFK
DOJRULWKP WKH DXWKRUV SXVKHG WKH ERXQGV XQWLO VSHFLILF
DOJRULWKPVZRXOGQRORQJHUEHDEOHWRKDQGOHWKHVXEVWDQWLDO
GDWDVL]HV
,Q>@WKHDXWKRUVFRPSDUHGGLIIHUHQWLPSOHPHQWDWLRQVRI
WKH TXLFN VRUW DOJRULWKP LQFOXGLQJ 4XLFN6RUW6HTXHQWLDO
4XLFN6RUW3DUDOOHO1DLYHDQG4XLFN6RUW)RUN-RLQ7KH\ UDQ
WKHLU WHVWV RQ ERWK D VLQJOH DQG GXDOFRUH SURFHVVRU XVLQJ D
PD[LPXP GDWDVHW VL]H RI WHQ PLOOLRQ 7KH UHVXOWV REWDLQHG
GHPRQVWUDWHGWKDWWKH4XLFN6RUW6HTXHQWLDOSHUIRUPHGZRUVW
ZKHUHDVWKH4XLFN6RUW3DUDOOHO1DLYHVXUSDVVHGLWE\
)XUWKHUPRUH 4XLFN6RUW)RUN-RLQ EHVWHG ERWK RI WKHP E\ D
PLQLPXPVSHHGXSRI
Authorized licensed use limited to: San Francisco State Univ. Downloaded on June 18,2021 at 18:34:16 UTC from IEEE Xplore. Restrictions apply.
7$%/(,
5HI
>@
>@
>@
>@
>@
>@
>@
>@
>@
>@
>@
>@
>@
>@
>@
$OJRULWKPWHVWHG
8VHGPRGHO
6800$5<2)7+(/,7(5$785(5(9,(:
0XOWLFRUH
7KUHDGV
'DWDVL]H
)LQGLQJV
$VWKHGDWDVL]HLQFUHDVHVWKHSHUIRUPDQFHRIWKH
-DYD 7KUHDG
0HUJHVRUW
7KUHDGV PLOOLRQ
SDUDOOHOLVEHWWHUWKDQWKHVHTXHQWLDO7KHQXPEHU
$3,
RISURFHVVRUVDOVRDIIHFWWKHVSHHGXSSRVLWLYHO\
IRUELWRQLFVRUW :KHQ GHDOLQJ ZLWK ODUJHU SUREOHPV ERWK 0HUJH
0HUJH VRUW %LWRQLF VRUW
2SHQ03
7KUHDGV
IRUWKHUHVW
DQGELWRQLFKDYHDEHWWHUVSHHGXS
5DGL[6RUW4XLFN6RUW
'XH WR SDUDOOHOL]DWLRQ RYHUKHDG WKH VHTXHQWLDO
4XLFNVRUW0HUJHVRUW
,QYRNH
'XDOFRUH YHUVLRQ EHVWHG WKHSDUDOOHO ZKHQ VL]H LV OHVV WKDQ
IRUTXLFNDQGOHVVWKDQIRUPHUJHVRUW
IRUPHUJHVRUW 7KHVWXG\DFKLHYHGDOLQHDUVSHHGXSRIXSWRWZLFH
0HUJH6RUW
2SHQ03
4XDGFRUH DQG IRU )OR\G¶V DV IDVW ZKHQ XVLQJ WKH SDUDOOHO PRGXOH YV WKH
)OR\G¶V$OJRULWKP
VHTXHQWLDO
DOJRULWKP
:LWK WKH GDWD VL]H ͳǤʹ ൈ ͳͲଵ 2QO\ WKH 4XLFN
0HUJH VRUW 4XLFN VRUW
2SHQ03
7KUHDGV ͳǤʹ ൈ ͳͲଽ VRUWDOJRULWKPLVDEOHWRKDQGOHWKHGDWDZKLOHERWK
&RXQWLQJVRUW
FRXQWLQJVRUWDQGPHUJHVRUWDUHXQDEOH
4XLFN
VRUW6HTXHQWLDO
4XLFN VRUW )RUN-RLQ ZDV E\ IDU WKH VXSHULRU
4XLFN 6RUW3DUDOOHO QDwYH 'XDOFRUH PLOOLRQ
DOJRULWKPVXUSDVVLQJERWK4XLFN6RUW6HTXHQWLDO
4XLFNVRUW)RUN-RLQ
DQG4XLFN6RUW3DUDOOHOQDwYHE\DWOHDVW
IRU VRUWLQJ
6SHHGXSLQWKHVHDUFKLQJDOJRULWKPUHDFKHG
1$
2SHQ03
'XDOFRUH DQG
IRU
ZKLOHLQVRUWLQJLWRQO\HYDOXDWHGWRVSHHGXS
VHDUFKLQJ
03-
03-([SUHVV DFKLHYHV DOPRVW JUHDWHU VSHHG
%XFNHW6RUW
([SUHVV
2FWDFRUH PLOOLRQ
DQGHIILFLHQF\WKDQ3303,
3303,
,Q ERWK DOJRULWKPV ZKHQ UXQQLQJ WKH SDUDOOHO
4XLFNVRUW&RQYH[KXOO
2SHQ03
'XDOFRUH PLOOLRQIRU
YHUVLRQVIRUPLOOLRQWKHUXQWLPHLVUHGXFHGWR
OHVVWKDQKDOI
$VWKHGDWDVL]HJHWVODUJHUKDYLQJPRUHWKUHDGVLV
%LQDU\VHDUFK
2SHQ03
7KUHDGV SRVLWLYHO\UHIOHFWLYHRQWKHUXQWLPH
,QVPDOOGDWDVL]HVWKHSDUDOOHODOJRULWKPSUHIRUPV
0DWUL[PXOWLSOLFDWLRQ
2SHQ03
'XDOFRUH î
VLPLODUO\WRWKHVHTXHQWLDOPHDQLQJWKDWPLQLPXP
RYHUKHDGLVUHTXLUHGIRUWKLVDOJRULWKP
IRU PDWUL[ 7KH SDUDOOHO PDWUL[ PXOWLSOLFDWLRQ LQ DOO WHVWHG
0DWUL[
PXOWLSOLFDWLRQ
PXOWLSOLFDWLRQ DQG LQSXWV KDG D EHWWHU UHVXOW :KLOH LQ )OR\G¶V
2SHQ03
7KUHDGV
)OR\G:DUVKDOO
IRU )OR\G¶V DOJRULWKPWKH HQKDQFHPHQW ZDV ZKHQWKHGDWDLV
DOJRULWKP
ODUJHUWKDQ
7KHDOJRULWKPDWWDLQHGXSWRWLPHVVSHHGXSLQWKH
0DWUL[PXOWLSOLFDWLRQ
2SHQ03
'XDOFRUH î
SDUDOOHOLPSOHPHQWDWLRQZLWKORJLFDOSURFHVVRUV
DQGDOPRVWWZLFHDVIDVWZLWKRQO\WZR
8VLQJ*38VWKHSDUDOOHODOJRULWKPUDQWLPHV
0D[LPXPVXEDUUD\
,QYRNH
4XDGFRUH î
IDVWHU WKDQ WKH VHTXHQWLDO FRXQWHUSDUW WKDW ZDV
WHVWHGXVLQJRQH&38
%LQDU\ VHDUFK VHTXHQWLDO UDQ IDVWHU RQ D
%LQDU\ VHDUFK /LQHDU
4XDGFRUH TXDGFRUH PDFKLQH 0RUHRYHU OLQHDU VHDUFK KDG
VHDUFK
WKHZRUVWUXQQLQJWLPHWKURXJKRXWWKHVWXG\
,Q DQ DQDO\VLV E\ >@ FRPSDULQJ VRUWLQJ DQG VHDUFKLQJ
VHTXHQWLDO DOJRULWKPV RQ D VLQJOHFRUH &38 ZLWK D SDUDOOHO
DOJRULWKP RQ D GXDOFRUH &38GLVSOD\HG DQ XQGHUZKHOPLQJ
UHVXOWRIDVSHHGXSIRUVRUWLQJ$QGDVSHHGXSIRU
VHDUFKLQJ5HJDUGOHVVWKHVHUHVXOWVPLJKWKDYHEHHQEHFDXVH
RIWKHXVHGDOJRULWKPZKLFKWKHSDSHUIDLOHGWRPHQWLRQ
$QRWKHUVRUWLQJDOJRULWKPEXFNHWVRUWZDVH[DPLQHGLQ
>@7KHSDSHUGLVWLQFWLWVHOIE\FRPSDULQJWKHSDUDOOHOEXFNHW
VRUWDOJRULWKPLQWZRGLVWLQFWLYHSDUDOOHOSURJUDPPLQJPRGHOV
XVLQJ D GDWD VL]H RI PLOOLRQ HOHPHQWV 7KH PRGHOV
FRPSDUHGZHUH03-([SUHVVDQG3303,ZKLFKLQWKHFDVH
RI WKH EXFNHW VRUW WKH 03-([SUHVV PRGHO DFKLHYHG EHWWHU
UHVXOWV LQ VSHHGXS DQG HIILFLHQF\ +RZHYHU WKLV PLJKW QRW
QHFHVVDULO\ EH WKH FDVH ZKHQ LPSOHPHQWLQJ GLIIHUHQW
DOJRULWKPV
,QDGGLWLRQ WRTXLFN VRUW WKHFRQYH[ KXOODOJRULWKP ZDV
H[DPLQHGLQDVLPLODUVHTXHQWLDOYVSDUDOOHOIDVKLRQE\>@
WKHWKHVLVFRPSDUHGWKHQXPEHURIFRPSDULVRQVPDGHZKLFK
ZDV DQ LQWHUHVWLQJ DGGLWLRQ WR WKH VWXG\ 6LPLODU WR DOO WKH
SUHYLRXV VWXGLHV LQ VPDOO GDWDVHW VL]HV WKH VHTXHQWLDO
DOJRULWKPV SHUIRUPHGEHWWHU WKDQ WKHLUSDUDOOHOFRXQWHUSDUWV
7KHUHDVRQIRUWKDWFDQEHDWWULEXWHGWRWKHRYHUKHDGQHHGHG
ZKHQH[HFXWLQJWKHDOJRULWKPRQWKHPXOWLFRUHV\VWHP7KH
VDPHUHVXOWFDQEHH[WHQGHGWRWKHVHDUFKLQJDOJRULWKPVWKDW
ZHUH WHVWHG LQ >@ 8VLQJ WKH ZHOONQRZQ ELQDU\ VHDUFK
DOJRULWKPWKHDXWKRUVXVHGHOHPHQWV
2WKHU VWXGLHV DWWHPSWHG WR FKDOOHQJH WKH SDUDOOHOLVP¶V
DELOLWLHV E\ FRQGXFWLQJ WHVWV RQ WKH 6WUDVVHQ¶V PDWUL[
PXOWLSOLFDWLRQ DOJRULWKP ZKLFK LV FRQVLGHUHG D IDU PRUH
VRSKLVWLFDWHGDOJRULWKPWKDQVRUWLQJDOJRULWKPV,QRQHVWXG\
>@DVL]HE\PDWUL[ZDVXVHGLQERWKWKHVHTXHQWLDO
DQGSDUDOOHODQDO\VLV7KHILQDOUHVXOWZDVEDVHGRQWKHDYHUDJH
RIWKUHHWULDOVRIHDFKVL]H,WZDVSURYHQWKDWWKURXJKRXWWKH
VWXG\IRUODUJHPDWULFHVWKHSDUDOOHOL]HGDOJRULWKPWUXPSVWKH
VHTXHQWLDOLPSOHPHQWDWLRQ+RZHYHULQRWKHUUHVHDUFKHVWKH
UHVXOWVZHUHXQGHUZKHOPLQJ)RULQVWDQFHLQWKHSDSHU>@
LW LV FOHDU WKDW ZKHQ H[HFXWLQJ WKH 6WUDVVHQ¶V PDWUL[
PXOWLSOLFDWLRQ DOJRULWKP LQ D TXDGWKUHDG SDUDOOHOL]HG
DOJRULWKPWKHUXQWLPHLVVLPLODUWRWKHVHTXHQWLDOH[HFXWLRQ
1RQHWKHOHVVWKHUHDVRQIRUWKLVFRXOGEHWKHVPDOOGDWDVL]H
WKHDXWKRUVZHUHXVLQJ,QFRQWUDVWDFRQVLGHUDEO\ODUJHGDWD
VHWZDVXVHGLQ>@ZLWKWKHVDPHQXPEHURIWKUHDGVXVHG
WKHH[SHULPHQWVKRZHGWKDWWKHVSHHGXSZLWKWKHSDUDOOHOL]HG
Authorized licensed use limited to: San Francisco State Univ. Downloaded on June 18,2021 at 18:34:16 UTC from IEEE Xplore. Restrictions apply.
DOJRULWKPIRUWKHPDWUL[ZDVDSSUR[LPDWHO\WKUHHWLPHVZKDW
LWZDVZKHQH[HFXWHGVHTXHQWLDOO\
,QDQRWKHUOLJKWWKHPD[LPXPVXEDUUD\SUREOHPZDVQRW
DVSRSXODULQUHVHDUFKDVRWKHUDOJRULWKPVZHUH+RZHYHUD
VWXG\ LQ >@ H[DPLQHG WKH UXQQLQJ WLPH RI WKH
DOJRULWKP XVLQJ PXOWLFRUH *38V LQ OLHX RI &38V 7KH
UHVHDUFK FRQWDLQHG XS WR HOHPHQWV UHVXOWLQJ LQ DQ
DVWRQLVKLQJVSHHGXSRIDOPRVWWLPHV
6WXGLHVWKDWKDYHEHHQUHYLHZHGDOOIDOOXQGHUSDUDOOHOLVP
YV VHTXHQWLDO DQDO\VLV $OWKRXJK SDUDOOHO SURJUDPPLQJ KDV
SURYHQ WR EH VXSHULRU DQDO\]LQJ KRZ DOJRULWKPV ZRUN
VHTXHQWLDOO\ RQ D PXOWLFRUH V\VWHP LOOXVWUDWHG UHPDUNDEOH
UHVXOWV /LNH LQ >@ WKH DXWKRUV UDQ H[SHULPHQWV XVLQJ WKH
VDPH VHTXHQWLDO DOJRULWKPV EXW ZLWK GLIIHUHQW FRUH
LQIUDVWUXFWXUHV 7KH UHVXOWV GLVSOD\HG WKDW D VHTXHQWLDO
DOJRULWKP FDQ EH IDVWHU RQ D TXDGFRUH &38 WKHQ LWV
SHUIRUPDQFHRQDVLQJOHFRUH&38+HQFHWKHQHHGWRIXUWKHU
H[DPLQHWKHSRWHQWLDORIWKLVPHWKRGRQGLIIHUHQWDOJRULWKPV
FDQ SURYH WR EH UHZDUGLQJ HVSHFLDOO\ LQ WKH FDVHV ZKHUH
SDUDOOHOSURJUDPPLQJLVQRWDYLDEOHRSWLRQ
$IWHU7KHXVDJHRIPXOWLFRUHSURFHVVRUVKDVEHHQXWLOL]HG
WR DQ H[WUHPH PDQ\ UHVHDUFKHV IRFXVHG WKH HIIRUWV RQ
SDUDOOHOL]LQJ DOJRULWKPV WKHQ DQDO\]LQJ WKH VSHHGXS FDXVHG
E\ WKH SDUDOOHOL]DWLRQ WHFKQLTXH DQG FRPSDULQJ LW WR WKH
VHTXHQWLDO UXQQLQJ WLPH 8VLQJ SDUDOOHO SURJUDPPLQJ LV
SURYHGWRKDYHEHWWHUVSHHGXSVZKHQGHDOLQJZLWKODUJHGDWD
6R UHSHDWLQJ WKH VDPH VWXGLHV ZLWK PLQLPDO FKDQJHV LV QRW
JRLQJ WR SURGXFH D PHDQLQJIXO FRQWULEXWLRQ 1RQHWKHOHVV
WKHUH DUH SOHQW\ RI SDUDOOHO SURJUDPPLQJ PRGXOHV DQG
SODWIRUPVDYDLODEOHVRFRPSDULQJWKHSDUDOOHOYHUVLRQRIWKH
DOJRULWKPRQWKHGLIIHUHQWPRGXOHVZLWKWKHJRDORIILQGLQJWKH
RQH ZLWK OHVV RYHUKHDG DQG PRUH VSHHGXS FDQ EH D PRUH
EHQHILFLDOVWXG\
&RQYHUVHO\LQ>@WKHDXWKRUVGLVSOD\HGSRWHQWLDOLQWKH
VSHHGXS HQKDQFHPHQWV E\ FRPSDULQJ WKH H[HFXWLRQ RI QRQ
SDUDOOHO DOJRULWKPV RQ PXOWLSOH PXOWLFRUH V\VWHPV 7KLV
PHWKRG FDQ EH RI XVH ZKHQ GHDOLQJ ZLWK DOJRULWKPV WKDW
FDQQRWEHSDUDOOHOL]HGDQGDUHLQQHHGRIDQHQKDQFHPHQWLQ
FRPSXWDWLRQDOSRZHU$OVRLWZDVHYLGHQWLQSDSHUVVXFKDV
>@>@>@>@>@VKRZWKDWZKHQGHDOLQJZLWKVPDOO
HQRXJK HOHPHQWV WKH H[HFXWLRQ WLPH IRU WKH VHTXHQWLDO
DOJRULWKP LV EHWWHU WKDQ WKH SDUDOOHO YHUVLRQ GXH WKH KLJK
RYHUKHDGFDXVHGE\SDUDOOHOL]DWLRQ,QRWKHUWHUPVWKHWLPHLW
WDNHVWRSDUDOOHOL]HDQDOJRULWKPFDQH[FHHGWKHUXQQLQJWLPH
LI WKH DOJRULWKP ZHUH WR EH UXQ VHTXHQWLDOO\ 7KHUHIRUH WKH
UHVXOWHGRYHUKHDGFDQDIIHFWWKHH[HFXWLRQWLPHLPPHQVHO\WR
WKH SRLQW WKDW XVLQJ VHTXHQWLDO DOJRULWKPV FRXOG DFWXDOO\ EH
PRUHHIILFLHQWWKDQWKH SDUDOOHO FRXQWHUSDUW +HQFH FUHDWLQJ
DQ RSWLRQ ZKHUH PXOWLFRUH LQIUDVWUXFWXUH FDQ EH XVHG WR
LPSURYHUXQQLQJWLPHZLWKRXWWKHGLVDGYDQWDJHVRIKDYLQJWR
GHDOZLWKRYHUKHDGFRXOGEHKHOSIXO
,9 (;3(5,0(17$/:25.
$OO WKH WHVWHG DOJRULWKPV PHUJH VRUW TXLFN VRUW DQG
6WUDVVHQ¶V PXOWLSOLFDWLRQ PDWUL[ ZHUH LPSOHPHQWHG
VHTXHQWLDOO\ XVLQJ WKH MDYD SURJUDPPLQJ ODQJXDJH RQ WKH
1HW%HDQV ,'( 7KH H[HFXWLRQ WLPH RI HDFK DOJRULWKP ZDV
FDOFXODWHGE\DGGLQJUDQGRPDQGXQLTXHQXPHULFYDOXHVWR
DUUD\VRIYDULHGVL]HV7KHH[HFXWLRQWLPHRIWKHPHWKRGVZHUH
FDOFXODWHGXVLQJWKHEXLOWLQMDYDV\VWHPPHWKRGQDQR7LPH LQVWHDGRIWKHPRUHFRPPRQFXUUHQW7LPH0LOOLV PHWKRGWKH
UHDVRQIRUWKLVFKRLFHLVWKDWWKHQDQR7LPH PHWKRGLVXVHG
WRFDOFXODWHWKHHODSVHGWLPHRIDSURJUDPHLWKHUDSDUWRIWKH
SURJUDP RU WKH SURJUDP DV D ZKROH ZKHUHDV WKH
FXUUHQW7LPH0LOOLV PHWKRG LV XVHG WR FDOFXODWH ZKDW LV
NQRZQDVZDOOFORFNZKLFKPLJKWQRWSURYLGHDFFXUDWHUHVXOWV
7KXV QDQR7LPH SURYLGHV D QDQRVHFRQG SUHFLVLRQ 7KH
QDQR7LPH ZDV XVHGWRFDOFXODWH VSHFLILFDOO\ WKH H[HFXWLRQ
WLPH RI WKH PHWKRGV LQ RSSRVH WR WKH SURJUDP DV D ZKROH
+RZHYHUWKHQDQRVHFRQGH[HFXWLRQZLOOWKHQEHFRQYHUWHGWR
PLOOLVHFRQGVIRUVLPSOHUDQDO\VLVDQGFDOFXODWLRQV
,Q RUGHU WR UHGXFH VRPH RI WKH PHDVXUHPHQW ELDVHV WKDW
PLJKWFDXVHXQUHOLDEOHUHVXOWVGXULQJHDFKWHVWVH[HFXWLRQDOO
SURFHVVHV WKDW FRXOG EH VWRSSHG ZHUH FORVHG VR WKDW WKH
GHGLFDWLRQRIWKH&38ZRXOGJRFRPSOHWHO\WRZDUGH[HFXWLQJ
WKH DOJRULWKP +RZHYHU LW VKRXOG EH QRWHG WKDW VRPH
RSHUDWLRQVH[HFXWHGE\WKH&38ZRXOGDOZD\VWDNHSODFHDQG
UXQLQWKHEDFNJURXQG:KLFKFRXOGSRWHQWLDOO\VORZGRZQWKH
V\VWHPWLPH,QDQDWWHPSWWRPLWLJDWHWKLVLVVXHDQDYHUDJHRI
WKHH[HFXWLRQWLPHRIWKUHHUXQVLVFRQVLGHUHGLQVWHDGRIMXVW
RQHSRWHQWLDOO\ELDVHGUXQ
$OO WKH WHVWHG DOJRULWKPV PHUJH VRUW TXLFN VRUW DQG
6WUDVVHQ¶V PXOWLSOLFDWLRQ PDWUL[ ZHUH LPSOHPHQWHG
VHTXHQWLDOO\ XVLQJ WKH MDYD SURJUDPPLQJ ODQJXDJH RQ WKH
1HW%HDQV ,'( (DFK DOJRULWKP ZDV H[HFXWHG RQ WKUHH
GHYLFHV WKDW KDYH GLIIHUHQW &38 DUFKLWHFWXUH 7KH
VSHFLILFDWLRQVRIHDFKRIWKHGHYLFHVDUHGLVSOD\HGLQ7$%/(
,,
7$%/(,,
&38
5$0
26
6WRUDJH
*38
352&(6625663(&,),&$7,21
4XDGFRUH
*+]
'XDO&RUH
,QWHO &RUH
L
*%
PDF26
&DWDOLQD
*%
66'
,QWHO ,ULV
*UDSKLFV
0%
9
4XDGFRUH
+H[DFRUH
*+] 4XDG
FRUH ,QWHO &RUH
L
,QWHO &RUH70 L
+*+]+H[D
FRUH3URFHVVRU
*%
*%
PDF26&DWDOLQD
:LQGRZVELW
*%66'
*%066'7%
+''
,QWHO
,ULV
*UDSKLFV 0%
19,',$*H)RUFH*7;
*% 3(5)250$1&($1$/<6,6
7KLVVHFWLRQSUHVHQWVWKHUHVXOWVREWDLQHGIURPWKHFRQGXFWHG
H[SHULPHQWDOZRUNDORQJZLWKWKHVSHHGXSFDOFXODWLRQVDQG
WKHGLVFXVVLRQRIWKHUHVXOWV
$ ([HFXWLRQ7LPH5HVXOWV
7$%/( ,,, GHSLFWV WKH DYHUDJH SHUIRUPDQFH RI VHYHUDO
WULDOUXQVRIWKHVHTXHQWLDOPHUJHVRUWDOJRULWKPDQGTXLFNVRUW
DOJRULWKP 7KH DOJRULWKPV ZHUH WHVWHG RQ DQ DUUD\ VL]H WKDW
UDQJHVIURPWRHOHPHQWV(DFKRIWKHVHDUUD\V
DUH VRUWHG RQ GXDOFRUH TXDGFRUH DQG KH[DFRUH &38¶V
$GGLWLRQDOO\WKHDYHUDJHH[HFXWLRQWLPHRIWULDOVLVFDOFXODWHG
DQGFRQYHUWHGWRPLOOLVHFRQGV
)LJLOOXVWUDWHVWKHDYHUDJHH[HFXWLRQWLPHRIWKHPHUJH
VRUWDOJRULWKPIRUHDFKRIWKHPXOWLFRUHDUFKLWHFWXUHV)LJ
LOOXVWUDWHV WKH DYHUDJH H[HFXWLRQ WLPH RI WKH TXLFN VRUW
DOJRULWKPIRUHDFKRIWKHPXOWLFRUHDUFKLWHFWXUHV
7$%/(,9LOOXVWUDWHVWKHDYHUDJHSHUIRUPDQFHRIVHYHUDO
WULDOUXQVRIWKHVHTXHQWLDO6WUDVVHQ¶VDOJRULWKPRQDGXDOFRUH
TXDGFRUH DQG KH[DFRUH DUFKLWHFWXUH 7KH DOJRULWKP ZDV
WHVWHGRQDWZRGLPHQVLRQDODUUD\VL]HWKDWUDQJHVIURPî
Authorized licensed use limited to: San Francisco State Univ. Downloaded on June 18,2021 at 18:34:16 UTC from IEEE Xplore. Restrictions apply.
WRîHOHPHQWV(DFKRIWKHVHPDWULFHVDUHPXOWLSOLHG
RQGXDOFRUHTXDGFRUHDQGKH[DFRUH&38¶V
)LJVKRZVDFRPSDULVRQRIWKHDYHUDJHH[HFXWLRQWLPH
RI6WUDVVHQ¶VPXOWLSOLFDWLRQPDWUL[DOJRULWKPIRUHDFKRIWKH
PXOWLFRUHDUFKLWHFWXUHV
[
7$%/(,9
)LJ([HFXWLRQWLPHRIPHUJHVRUWRQGXDOTXDGDQGKH[DFRUH&38
(;(&87,217,0(2)675$66(1 6$/*25,7+021
$'8$/48$'$1'+(;$&25(&38
$UUD\VL]H
6WUDVVHQ VDOJRULWKP
'XDOFRUH
4XDGFRUH +H[DFRUH
î
î
î
î
î
% 6SHHGXS&DOFXODWLRQV
,QRUGHUWRHYDOXDWHWKHVSHHGXSJDLQHGE\WKHTXDGFRUH
&38¶VWKHIROORZLQJIRUPXODZDVXWLOL]HG
σ௫
ݑ݀݁݁ݏൌ σ ௬
ZKHUHݔUHSUHVHQWVWKHDYHUDJHH[HFXWLRQWLPHRIWKHGXDO
FRUH IRU HDFK WULDO $QGݕUHSUHVHQWV WKH DYHUDJH H[HFXWLRQ
WLPHRIWKHTXDGFRUHIRUHDFKWULDO7$%/(9GLVSOD\VWKH
VSHHGXSJDLQHGE\WKHTXDGFRUH&38ZKHQFRPSDUHGZLWK
WKHGXDOFRUH&38
)LJ([HFXWLRQWLPHRITXLFNVRUWRQGXDOTXDGDQGKH[DFRUH&38
)LJ([HFXWLRQWLPHRI6WUDVVHQ VDOJRULWKPRQPXOWLFRUH&38V
7$%/(,,,
'DWD
6L]H
E\WHV
$9(5$*((;(&87,217,0( 06 2)0(5*(625721
'8$/48$'$1'+(;$&25(&38
PHUJHVRUW
TXLFNVRUW
'XDO
FRUH
4XDG
FRUH
+H[D
FRUH
'XDO
FRUH
4XDG
FRUH
+H[D
FRUH
[
7$%/(9
'8$/&25(9648$'&25(63(('83
6SHHGX
6SHHGXS
S
SHUFHQWDJH
$OJRULWKP
σݔ
σݕ
0HUJHVRUW
4XLFNVRUW
6WUDVVHQ¶V
0DWUL[
0XOWLSOLFDWLRQ
(T LVXVHGWRHYDOXDWHWKHVSHHGXSJDLQHGE\WKHKH[D
FRUH&38¶VZKHUHݔUHSUHVHQWVWKHDYHUDJHH[HFXWLRQWLPHRI
WKH GXDOFRUH IRU HDFK WULDO $QG ݕUHSUHVHQWV WKH DYHUDJH
H[HFXWLRQ WLPH RI WKH KH[DFRUH IRU HDFK WULDO 7$%/( 9,
GLVSOD\V WKH VSHHGXS JDLQHG E\ WKH KH[DFRUH &38 ZKHQ
FRPSDUHGZLWKWKHGXDOFRUH&38
7$%/(9,
'8$/&25(96+(;$&25(63(('83
6SHHGXS
$OJRULWKP
σݔ
σݕ
6SHHGXS
0HUJHVRUW
4XLFNVRUW
6WUDVVHQ¶V
0DWUL[
0XOWLSOLFDWLRQ
SHUFHQWDJH
& 5HVXOWV'LVFXVVLRQ
7KHH[SHULPHQWDOUHVXOWVRIWKUHHVHTXHQWLDODOJRULWKPVRQ
D GXDOFRUH TXDGFRUH DQG D KH[DFRUH &38 VKRZHG WKDW
ZKHQFRPSDULQJWKHTXDGFRUHWRWKHGXDOFRUHIRUERWKPHUJH
VRUWDQGTXLFNVRUWDURXJKO\YDOXHRIPRUHWKDQVSHHGXS
ZDV DFKLHYHG &RQVHTXHQWLDOO\ ZKHQ FRPSDULQJ WKH KH[D
Authorized licensed use limited to: San Francisco State Univ. Downloaded on June 18,2021 at 18:34:16 UTC from IEEE Xplore. Restrictions apply.
FRUHWRWKHGXDOFRUHIRUERWKPHUJHVRUWDQGTXLFNVRUWWKH
H[HFXWLRQWLPHIRUWKHKH[DFRUHZDVWZRWLPHVIDVWHUWKDQWKH
GXDOFRUH $V IRU 6WUDVVHQ¶V PXOWLSOLFDWLRQ DOJRULWKP WKH
UHVXOWV DUH VOLJKWO\ GLIIHUHQW ZKHUH WKH TXDGFRUH LPSURYHG
WKHH[HFXWLRQWLPHE\DPHUHZKHUHDVIRUWKHKH[D
FRUHWKHJDLQHGVSHHGXSZDVWLPHVIDVWHU7KHUHDVRQERWK
WKHTXDGDQGKH[DFRUH&38¶VGLGQ¶WSHUIRUPLQWKH6WUDVVHQ¶V
PXOWLSOLFDWLRQDOJRULWKPDVZHOODVWKH\GLGIRUPHUJHVRUWDQG
TXLFNVRUWFDQEHDWWULEXWHGWRWKHIDFWWKH6WUDVVHQ¶VDOJRULWKP
KDVKLJKSRO\QRPLDOWLPHFRPSOH[LW\ZKHUHDVPHUJHVRUWDQG
TXLFN VRUW LQ SUDFWLFH ERWK KDYH OLQHDU WLPHFRPSOH[LWLHV
+RZHYHUDOWKRXJKWKHVSHHGXSZDVOHVVWKDQWZLFHDVIDVWDQ
LPSURYHPHQWRILVDVDWLVIDFWRU\UHVXOW
7KXVEDVHGRQ WKHUHVXOWV RISDVW VWXGLHV ZKHQ GHDOLQJ
ZLWK QRQSDUDOOHOL]DEOHDOJRULWKPV E\ UXQQLQJ WKHDOJRULWKP
RQDVWURQJHQRXJKPXOWLFRUHV\VWHPWKHDFKLHYHGVSHHGXSV
FDQULYDOWKHVSHHGXSDWWDLQHGRIDSDUDOOHOL]HGYHUVLRQRIWKH
DOJRULWKP RQ WKH VDPH &38 HVSHFLDOO\ LI WKH GHYHORSHG
DOJRULWKP KDV UHODWLYHO\ ORZ WLPHFRPSOH[LW\ $GGLWLRQDOO\
IURPWKHUHVXOWVLQ7$%/(,,,DQG7$%/(,9LWLVHYLGHQWO\
FOHDUWKDWLQDOOFDVHVLQFOXGLQJVPDOOGDWDVL]HVWKHTXDGFRUH
DQG KH[DFRUH DOZD\V RXWSHUIRUP WKH GXDOFRUH +HQFH
FRQFOXGLQJWKDWXQOLNHSDUDOOHOL]DWLRQE\UXQQLQJVHTXHQWLDO
DOJRULWKPVRQDEHWWHUPXOWLFRUHFRPSXWHURYHUKHDGLVVXHV
DUH QRWD FRQFHUQ7KHUHIRUHIRU FDVHV ZKHUH WKHGDWD VL]HV
DUHQ¶WKXJHHYHQLIWKHDOJRULWKPLVSDUDOOHOL]DEOHXVLQJWKH
VHTXHQWLDODOJRULWKPRQDVWURQJHUSURFHVVRUZLOOLPSURYHWKH
SHUIRUPDQFHRIWKHH[HFXWLRQWLPH
9, &21&/86,21
,PSURYLQJH[HFXWLRQWLPHDQGVSHHGXSE\XWLOL]LQJPXOWL
FRUH SURFHVVRUV LV D KLJKO\ VRXJKWRXW SUREOHP 7KLV SDSHU
VWXGLHG WKH HIIHFWV RI PXOWLFRUH SURFHVVRUV RQ VHTXHQWLDO
GLYLGH DQG FRQTXHU DOJRULWKPV 1DPHO\ PHUJH VRUW TXLFN
VRUWDQG6WUDVVHQ¶VPDWUL[PXOWLSOLFDWLRQ7KHH[HFXWLRQWLPH
DQGVSHHGXSRIHDFKDOJRULWKPRQGLIIHUHQWLQSXWVL]HVZHUH
VXFFHVVIXOO\ HYDOXDWHG FDOFXODWHG DQG FRPSDUHG RQ D GXDO
TXDGDQGKH[DFRUH&387KHUHVXOWVREWDLQHGVKRZHGWKDW
WKHRYHUDOOSHUIRUPDQFHRIWKHTXDGFRUHEHDWWKHGXDOFRUHRQ
PHUJH VRUW TXLFN VRUW DQG 6WUDVVHQ¶V DOJRULWKP E\ DQ
LPSURYHPHQW UDWH RI DQG UHVSHFWLYHO\ 6XEVHTXHQWO\ WKH KH[DFRUH RXWSHUIRUPHG WKH
GXDOFRUHE\DQLPSURYHPHQWUDWHRIDQG
UHVSHFWLYHO\)XUWKHUPRUHWKHUHVXOWVGLVSOD\HGWKDW
WKHTXDGFRUHDQGKH[DFRUHSHUIRUPHGEHWWHUWKDQWKHGXDO
FRUHIRUDOOWULDOV&RQVHTXHQWO\SURYLQJWKDWWKHUHH[LVWVQR
RYHUKHDGZKHQUXQQLQJVHTXHQWLDODOJRULWKPVRQKLJKHUPXOWL
FRUH &38¶V ,Q FRQFOXVLRQ UXQQLQJ DOJRULWKPV RQ D PRUH
SRZHUIXOPXOWLFRUH&38FDQUHGXFHWKHH[HFXWLRQWLPHDWD
VDWLVIDFWRU\ UDWH ZKLFK LV KHOSIXO ZKHQ GHDOLQJ ZLWK
XQSDUDOOHOL]DEOH DOJRULWKPV RU SDUDOOHOL]HG DOJRULWKPV WKDW
KDYHDKLJKRYHUKHDGFRVW
)RUIXWXUHZRUNWKHSHUIRUPDQFHRIGLIIHUHQWDOJRULWKPV ZLWK KLJKHU WLPH FRPSOH[LWLHV FRXOG EH HYDOXDWHG
$GGLWLRQDOO\ HYDOXDWLQJSDUDOOHOL]HG DOJRULWKPV RQGLIIHUHQW
SDUDOOHOPRGXOHVFRXOGKHOSLQFKRRVLQJZKLFKPRGHOFDXVHV
OHVVRYHUKHDG
5()(5(1&(6
6XWWHU+HUE³7KH)UHH/XQFK,V2YHUௗ$)XQGDPHQWDO7XUQ7RZDUG
&RQFXUUHQF\LQ6RIWZDUH´'U'REE¶V-YROQRSS±
,QWHO ³,17(/ &25(70 L;( (;75(0( (',7,21
352&(6625´
>2QOLQH@
$YDLODEOH
KWWSVZZZLQWHOFRPFRQWHQWZZZXVHQSURGXFWVSURFHVVRUVFRUH[
VHULHVL[HKWPO>$FFHVVHG2FW@
0+HUOLK\DQG16KDYLW³7KH$UWRI0XOWLSURFHVVRU3URJUDPPLQJ
5HYLVHG5HSULQW´VWHG0RUJDQ.DXIPDQQSS±
6 6 6NLHQD DQG 6 6 6NLHQD ³0HUJHVRUW 6RUWLQJ E\ 'LYLGHDQG
&RQTXHU´ LQ 7KH $OJRULWKP 'HVLJQ 0DQXDO 6HFRQG 6SULQJHU
/RQGRQSS±
7+&RUPHQ&(/HLVHUVRQ5/5LYHVWDQG&6WHLQ,QWURGXFWLRQ
WR$OJRULWKPV7KLUG(GLWLRQUGHG7KH0,73UHVV
5 6HGJHZLFN DQG . :D\QH $OJRULWKPV )RXUWK HGLWLRQ $GGLVRQ
:HVOH\
$-.DZX$<DKD\D8PDUDQG6,%DOD3HUIRUPDQFHRIRQHOHYHO
UHFXUVLRQSDUDOOHO6WUDVVHQ VDOJRULWKPRQGXDOFRUHSURFHVVRU
,(((UG,QWHUQDWLRQDO&RQIHUHQFHRQ(OHFWUR7HFKQRORJ\IRU1DWLRQDO
'HYHORSPHQW 1,*(5&21 2ZHUUL1LJHULDSS
$9DMGD3URJUDPPLQJ0DQ\&RUH&KLSVVWHG6SULQJHU3XEOLVKLQJ
&RPSDQ\,QFRUSRUDWHG
'*HHU³&KLSPDNHUVWXUQWRPXOWLFRUHSURFHVVRUV´&RPSXWHU /RQJ
%HDFK&DOLI YROQRSS±0D\
3'HVKPXNK$.XUXSDQG6.XONDUQL³(IIHFWLYHXVHRI0XOWL&RUH
$UFKLWHFWXUHWKURXJK0XOWL7KUHDGLQJWRZDUGV&RPSXWDWLRQ,QWHQVLYH
6LJQDO3URFHVVLQJ$SSOLFDWLRQV´,QW-&RPSXW$SSOYROSS
±
66=DJKORXO/0$O6KHKUL0)$O-RXLH1($O(LVVDDQG1
$ $O0RJKHHUDK ³$QDO\WLFDO DQG ([SHULPHQWDO 3HUIRUPDQFH
(YDOXDWLRQRI3DUDOOHO0HUJHVRUWRQ0XOWLFRUH6\VWHP´LQWMRXUHQJ
FRPVFLYROQR-XQ
97KDNXUDQG6.XPDU³3HUIRUPDQFH$QDO\VLVRI6RUWLQJ$OJRULWKPV
LQ0XOWLFRUH$UFKLWHWXUH´YROQRSS±
7 6LQJK DQG ' .XPDU ³7KUHVKROG $QDO\VLV DQG &RPSDULVRQ RI
6HTXHQWLDODQG3DUDOOHO'LYLGHDQG&RQTXHU6RUWLQJ$OJRULWKPV´,QW
-&RPSXW$SSOYROQRSS±
%0XVWDIDDQG:$KPHG³3DUDOOHO$OJRULWKP3HUIRUPDQFH$QDO\VLV
XVLQJ 2SHQ03 IRU 0XOWLFRUH 0DFKLQHV ,QWHUQDWLRQDO -RXUQDO RI
$GYDQFHG &RPSXWHU 7HFKQRORJ\ ,-$&7 YRO QR SS ±
7 8PHGD DQG 6 2\D ³3HUIRUPDQFH &RPSDULVRQ RI 2SHQ6RXUFH
3DUDOOHO6RUWLQJZLWK2SHQ03´3URFUG,QW6\PS&RPSXW
1HWZRUNLQJ&$1'$5SS±
$ 0 5DELX $ % *DUNR $ 0 $EGXOODKL + $ 8PDU DQG 0
%DEDJDQD ³3HUIRUPDQFH (YDOXDWLRQ RI 7KUHH 4XLFN VRUWLQJ
$OJRULWKPVRQD6LQJOHDQG0XOWLFRUH3URFHVVRUV´YROQRSS
±
& 9HQNDWD 6LYD 3UDVDG 65DYL DQG 9 .DUWKLNH\DQ ³3HUIRUPDQFH
LPSURYHPHQWLQGDWDVHDUFKLQJDQGVRUWLQJ8VLQJPXOWLFRUH´$531
-(QJ$SSO6FLYROQRSS±
0,/DOL:$VODP)8OODK061DZD]65D]]DNDQG6=DKRRU
³&RPSDUDWLYH $QDO\VLV RI 3HUIRUPDQFH $FKLHYHG ZLWK 0XOWL&RUH
3URJUDPPLQJ0RGHOVLQ-DYD´6LQGK8QLYHUVLW\5HVHDUFK-RXUQDOYRO
QRSS
6 'DVK DQG . 'RUD ³$QDO\VLQJ WKH 3HUIRUPDQFH RI 'LYLGHDQG
&RQTXHU$OJRULWKPVRQ0XOWLFRUH3URFHVVRUV´06WKHVLV1DWLRQDO
,QVWLWXWHRI7HFKQRORJ\
6 'XE\ DQG . 'U 0DWKXU ³&RPSDUDWLYH 3HUIRUPDQFH $QDO\VLV RI
%LQDU\6HDUFKLQ6HTXHQWLDODQG3DUDOOHO3URFHVVLQJ´,QW-5HV$SSO
6FL(QJ7HFKQROYROQR;SS±
3 .XONDUQL DQG 6 3DWKDUH ³3HUIRUPDQFH $QDO\VLV RI 3DUDOOHO
$OJRULWKP RYHU 6HTXHQWLDO XVLQJ 2SHQ03´ ,265 - &RPSXW (QJ
YROQRSS±
6 .$7+$9$7( DQG 1 . 65,1$7+ ³(IILFLHQF\ RI 3DUDOOHO
$OJRULWKPV RQ0XOWL&RUH 6\VWHPV 8VLQJ 2SHQ03´ ,MDUFFH YRO QRSS±
&6)HUUHLUD5<&DPDUJRDQG6:6RQJ³$SDUDOOHOPD[LPXP
VXEDUUD\ DOJRULWKP RQ *38V´ 3URF 6\PS &RPSXW $UFKLW +LJK
3HUIRUP&RPSXWYRO2FWRSS±
$05DELX$%*DUNRDQG$0$EGXOODKL³(IIHFWVRI0XOWLFRUH
3URFHVVRUVRQ/LQHDUDQG%LQDU\6HDUFK$OJRULWKPV´YROQRSS
±
Authorized licensed use limited to: San Francisco State Univ. Downloaded on June 18,2021 at 18:34:16 UTC from IEEE Xplore. Restrictions apply.