Spam Recognition using Linear Regression and

:
5RCO4GEQIPKVKQPWUKPI.KPGCT4GITGUUKQPCPF
4CFKCN$CUKU(WPEVKQP0GWTCN0GVYQTM
7LFK3KXRF7UDQ0LQ/L'DW7UDQDQG'DP'XRQJ7RQ
&HQWUHIRU4XDQWXP&RPSXWDWLRQDQG,QWHOOLJHQW6\VWHPV4&,6
8QLYHUVLW\RI7HFKQRORJ\6\GQH\16:$XVWUDOLD
^WLSWUDQPLQOL`#LWXWHGXDX
)DFXOW\RI,QIRUPDWLRQ6FLHQFHVDQG(QJLQHHULQJ
8QLYHUVLW\RI&DQEHUUD$&7$XVWUDOLD
GDWWUDQ#FDQEHUUDHGXDX
)DFXOW\RI&RPSXWHU6FLHQFH
8QLYHUVLW\RI,QIRUPDWLRQ7HFKQRORJ\918+&0&9LHWQDP
GDPGW#XLWHGXYQ
.H\ZRUGV6SDP5HFRJQLWLRQ5HGLDO%DVLV)XQFWLRQ/LQHDU5HJUHVVLRQ
#DUVTCEV
6SDPPLQJLVWKHDEXVHRIHOHFWURQLFPHVVDJLQJV\VWHPVWRVHQGXQVROLFLWHGEXONPHVVDJHV
,W LV EHFRPLQJ D VHULRXV SUREOHP IRU RUJDQL]DWLRQV DQG LQGLYLGXDO HPDLO XVHUV GXH WR WKH
JURZLQJ SRSXODULW\ DQG ORZ FRVW RI HOHFWURQLF PDLOV 8QOLNH RWKHU ZHE WKUHDWV VXFK DV
KDFNLQJ DQG ,QWHUQHW ZRUPV ZKLFK GLUHFWO\ GDPDJH RXU LQIRUPDWLRQ DVVHWV VSDP FRXOG
KDUP WKH FRPSXWHU QHWZRUNV LQ DQ LQGLUHFW ZD\ UDQJLQJ IURP QHWZRUN SUREOHPV OLNH
LQFUHDVHGVHUYHUORDGGHFUHDVHGQHWZRUNSHUIRUPDQFHDQGYLUXVHVWRSHUVRQQHOLVVXHVOLNH
ORVW HPSOR\HH WLPH SKLVKLQJ VFDPV DQG RIIHQVLYH FRQWHQW 7KRXJK D ODUJH DPRXQW RI
UHVHDUFK KDV EHHQ FRQGXFWHG LQ WKLV DUHD WR SUHYHQW VSDPPLQJ IURP XQGHUPLQLQJ WKH
XVDELOLW\ RI HPDLO FXUUHQWO\ H[LVWLQJ ILOWHULQJ PHWKRGV· SHUIRUPDQFH VWLOO VXIIHUV IURP
H[WHQVLYH FRPSXWDWLRQ ZLWK ODUJH YROXPH RI HPDLOV UHFHLYHG DQG XQUHOLDEOH SUHGLFWLYH
FDSDELOLW\ GXH WR KLJKO\ G\QDPLF QDWXUH RI HPDLOV ,Q WKLV FKDSWHU ZH GLVFXVV WKH
FKDOOHQJLQJ SUREOHPV RI 6SDP 5HFRJQLWLRQ DQG WKHQ SURSRVH DQ DQWLVSDP ILOWHULQJ
IUDPHZRUNLQZKLFKDSSURSULDWHGLPHQVLRQUHGXFWLRQVFKHPHVDQGSRZHUIXOFODVVLILFDWLRQ
PRGHOV DUH HPSOR\HG ,Q SDUWLFXODU 3ULQFLSDO &RPSRQHQW $QDO\VLV WUDQVIRUPV GDWD WR D
ORZHUGLPHQVLRQDOVSDFHZKLFKLVVXEVHTXHQWO\XVHGWRWUDLQDQ$UWLILFLDO1HXUDO1HWZRUN
EDVHG FODVVLILHU $ FRVWVHQVLWLYH HPSLULFDO DQDO\VLV ZLWKDSXEOLFO\ DYDLODEOH HPDLO FRUSXV
QDPHO\/LQJ6SDPVXJJHVWVWKDWRXUVSDPUHFRJQLWLRQIUDPHZRUNRXWSHUIRUPVRWKHUVWDWH
RIWKHDUWOHDUQLQJPHWKRGVLQWHUPVRIVSDPGHWHFWLRQFDSDELOLW\,QWKHFDVHRIH[WUHPHO\
www.intechopen.com
#
KLJK PLVFODVVLILFDWLRQ FRVW ZKLOH RWKHU PHWKRGV· SHUIRUPDQFH GHWHULRUDWHV VLJQLILFDQWO\ DV
WKHFRVWIDFWRULQFUHDVHVRXUPRGHOVWLOOUHPDLQVVWDEOHDFFXUDF\ZLWKORZFRPSXWDWLRQFRVW
+PVTQFWEVKQP
(PDLO LV ZLGHO\DFFHSWHG E\ WKH EXVLQHVV FRPPXQLW\DVD ORZ FRVW FRPPXQLFDWLRQ WRRO WR
H[FKDQJH LQIRUPDWLRQ EHWZHHQ EXVLQHVV HQWLWLHV ZKLFK DUH SK\VLFDOO\ GLVWDQW IURP RQH
DQRWKHU,WPLQLPL]HVWKHFRVWRIRUJDQL]LQJDQLQSHUVRQPHHWLQJ,WLVUHSRUWHGE\DUHFHQW
VXUYH\6XUH3D\UROO6XUHSD\UROORYHURIVPDOOEXVLQHVVRZQHUVEHOLHYHHPDLOLVD
NH\ WR WKH VXFFHVV RI WKHLU EXVLQHVV DQG PRVW SHRSOH WRGD\ VSHQG EHWZHHQ WR RI
WKHLU ZRUNLQJ WLPH XVLQJ HPDLO LQFOXGLQJ UHDGLQJ VRUWLQJ DQG ZULWLQJ HPDLOV 'XH WR WKH
YHU\ORZFRVWRIVHQGLQJHPDLORQHFRXOGVHQGWKRXVDQGVRIPDOLFLRXVHPDLOPHVVDJHVHDFK
GD\ RYHU DQ LQH[SHQVLYH ,QWHUQHW FRQQHFWLRQ 7KHVH MXQN HPDLOV UHIHUUHG WR DV VSDP FDQ
VHYHUHO\ UHGXFH VWDII SURGXFWLYLW\ FRQVXPH VLJQLILFDQW QHWZRUN EDQGZLGWK DQG OHDG WR
VHUYLFHRXWDJHV,QPDQ\FDVHVVXFKPHVVDJHVDOVRFDXVHH[SRVXUHWRYLUXVHVVS\ZDUHDQG
LQDSSURSULDWHFRQWHQWVWKDWFDQFUHDWHOHJDOFRPSOLDQFHLVVXHVORVVRISHUVRQDOLQIRUPDWLRQ
DQGFRUSRUDWHDVVHWV7KHUHIRUHLWLVLPSRUWDQWWRDFFXUDWHO\HVWLPDWHFRVWVDVVRFLDWHGZLWK
VSDP DQG HYDOXDWH WKH HIIHFWLYHQHVV RI FRXQWHUPHDVXUHV VXFK DV VSDPILOWHULQJ WRROV
7KRXJKVXFKVSDPSUHYHQWLRQFDSDELOLW\LVLPSOHPHQWHGLQH[LVWLQJHPDLOFOLHQWVWKHUHDUH
VRPH EDUULHUV WKDW GLVFRXUDJH XVHUV IURP XWLOL]LQJ WKLV IHDWXUH LQFOXGLQJ HUURUSURQH DQG
ODERULQWHQVLYH PDLQWHQDQFH RI ILOWHULQJ UXOHV 0DQ\ UHVHDUFKHUV KDYH GHYHORSHG GLIIHUHQW
DXWRPDWLFVSDPGHWHFWLRQV\VWHPVEXWPRVWRIWKHPVXIIHUIURPORZDFFXUDF\DQGKLJKIDOVH
DODUP UDWH GXH WR KXJH YROXPH RI HPDLOV WKH ZLGH VSHFWUXP RI VSDPPLQJ WRSLFV DQG
UDSLGO\FKDQJLQJFRQWHQWVRIWKHVHPHVVDJHVHVSHFLDOO\LQWKHFDVHRIKLJKPLVFODVVLILFDWLRQ
FRVW %D\OHU 7R GHDO ZLWK VXFK FKDOOHQJHV WKLV FKDSWHU SURSRVHV DQ DQWLVSDP
ILOWHULQJ IUDPHZRUN XVLQJ D KLJKO\ SHUIRUPLQJ $UWLILFLDO 1HXUDO 1HWZRUN $11 EDVHG
FODVVLILHU $11 LV ZLGHO\ FRQVLGHUHG DV D IOH[LEOH ´PRGHOIUHH RU ´GDWDGULYHQµ OHDUQLQJ
PHWKRG WKDW FDQ ILW WUDLQLQJ GDWD YHU\ ZHOO DQG WKXV UHGXFH OHDUQLQJ ELDV KRZ ZHOO WKH
PRGHOILWVWKHDYDLODEOHVDPSOHGDWD+RZHYHUWKH\DUHDOVRVXVFHSWLEOHWRWKHRYHUILWWLQJ
SUREOHP ZKLFK FDQ LQFUHDVH JHQHUDOL]DWLRQ YDULDQFH LH PDNLQJ WKH SUHGLFWLYH PRGHO
XQVWDEOHIRUXQVHHQLQVWDQFHV7KLVOLPLWDWLRQFDQEHRYHUFRPHE\FRPELQLQJ$11ZLWKD
VLPSOH/LQHDU5HJUHVVLRQDOJRULWKPZKLFKPDNHVWKHUHVXOWLQJFODVVLILFDWLRQPRGHODVWDEOH
VHPLSDUDPHWULF FODVVLILHU 6XFK PRGHO FRPELQDWLRQ DLPV DW VWDELOL]LQJ QRQOLQHDU OHDUQLQJ
WHFKQLTXHV ZKLOH UHWDLQLQJ WKHLU GDWD ILWWLQJ FDSDELOLW\ (PSLULFDO DQDO\VLV ZLWK WKH /LQJ
6SDPEHQFKPDUNFRQILUPVRXUVXSHULRUVSDPGHWHFWLRQDFFXUDF\DQGORZFRPSXWDWLRQFRVW
LQFRPSDULVRQZLWKRWKHUH[LVWLQJDSSURDFKHV
7KLVFKDSWHULVRUJDQL]HGDVIROORZ)LUVWO\DQRYHUYLHZRIWKHVSDPSUREOHPLVSUHVHQWHG
ZLWK DVVRFLDWHG QHJDWLYH LPSDFWV DQG SURWHFWLRQ WHFKQLTXHV 7KLV LV IROORZHG E\ WKH
DSSOLFDWLRQRI0DFKLQH/HDUQLQJ0/WRVSDPUHFRJQLWLRQUHODWHGZRUNVDQGGHWDLOVRIWKH
/LQJ6SDPFRUSXV1H[WDEULHIUHYLHZRIVHYHUDOFRPPRQO\XVHGFODVVLILFDWLRQPRGHOVDQG
RXUSURSRVHGIUDPHZRUNLVJLYHQ7KHVXEVHTXHQWVHFWLRQFRPSDUHVWKHSHUIRUPDQFHRIRXU
PHWKRG ZLWK RWKHU OHDUQLQJ WHFKQLTXHV XVLQJ WKH EHQFKPDUN FRUSXV XQGHU GLIIHUHQW FRVW
VFHQDULRV)LQDOO\ZHSURYLGHVRPHFRQFOXVLRQUHPDUNVIRUWKLVFKDSWHUDQGIXWXUHUHVHDUFK
GLUHFWLRQV
www.intechopen.com
5RCO4GEQIPKVKQPCPF/CEJKPG.GCTPKPIVGEJPKSWGU
5RCO4GEQIPKVKQPCUC%JCNNGPIKPI6CUM
1XGTXKGYQH5RCOOKPI
6SDPPLQJ LV RQH RI WKH ELJJHVW FKDOOHQJHV IDFLQJ ,QWHUQHW FRQVXPHUV FRUSRUDWLRQV DQG
VHUYLFH SURYLGHUV WRGD\ (PDLO VSDPPLQJ DOVR NQRZQ DV 8QVROLFLWHG %XON (PDLO 8%( RU
8QVROLFLWHG &RPPHUFLDO (PDLO 8&( LV WKH SUDFWLFH RI VHQGLQJ XQZDQWHG HPDLO PHVVDJHV
IUHTXHQWO\ZLWKFRPPHUFLDOFRQWHQWLQODUJHTXDQWLWLHVWRDQLQGLVFULPLQDWHVHWRIUHFLSLHQWV
6FKU\HQ'XHWRWKHLQFUHDVLQJSRSXODULW\DQGORZFRVWRIHPDLOWKHUHDUHPRUHDQG
PRUH VSDP FLUFXODWLQJ RYHU WKH ,QWHUQHW 6SDP HPDLOV ZHUH IRXQG WR DFFRXQW IRU
DSSUR[LPDWHO\ RI WKH LQFRPLQJ PHVVDJH WR FRUSRUDWH QHWZRUNV / ) &UDQRU /D0DFFKLDDQGFXUUHQWO\FRVWVEXVLQHVVHV86ELOOLRQDQQXDOO\6ZDUW]1RW
RQO\ZDVWLQJWLPHDQGFRQVXPLQJEDQGZLGWKXQGHVLUHGHPDLOVDUHH[WUHPHO\DQQR\LQJWR
PRVW XVHUV GXH WR WKHLU XQVXLWDEOH FRQWHQWV UDQJLQJ IURP DGYHUWLVLQJ YDFDWLRQV WR
SRUQRJUDSKLFPDWHULDOV
6SDPLVXVXDOO\FODVVLILHGLQWRWZRFDWHJRULHVZKLFKKDYHGLIIHUHQWHIIHFWVRQ,QWHUQHWXVHUV
&DQFHOODEOH8VHQHWVSDPLVDVLQJOHPHVVDJHVHQWWRPDQ\8VHQHWQHZVJURXSV:ROIH6FRWW
(UZLQ7KLVVSDPPLQJDWWDFNFDQRYHUZKHOPWKHXVHUVZLWKDEDUUDJHRIDGYHUWLVLQJ
RU RWKHU LUUHOHYDQW SRVWV ,W DOVR VXEYHUWV WKH DELOLW\ RI V\VWHP DGPLQLVWUDWRUV DQG JURXS
RZQHUVWRPDQDJHWKHWRSLFVWKH\DFFHSWRQWKHLUV\VWHPV7KHVHFRQGW\SHRIVSDPLV(PDLO
VSDP ZKLFK WDUJHWV LQGLYLGXDO XVHUV ZLWK GLUHFW PDLO PHVVDJHV %D\OHU 1RW RQO\
FDXVLQJ ORVV RI SURGXFWLYLW\ IRU HPDLO XVHUV LW DOVR FRVWV PRQH\ IRU ,QWHUQHW 6HUYLFH
3URYLGHUV,63DQGRQOLQHVHUYLFHVWRWUDQVPLWVSDPDQGWKHVHFRVWVDUHWUDQVIHUUHGGLUHFWO\
WRRWKHUVXEVFULEHUV7KRXJKWKHUHDUHGLIIHUHQWW\SHVRIVSDPWKH\DOOVKDUHVRPHFRPPRQ
SURSHUWLHV)LUVWWKHVHQGHU·VLGHQWLW\DQGDGGUHVVDUHFRQFHDOHG6HFRQGVSDPHPDLOVDUH
VHQW WR D ODUJH QXPEHU RI UHFLSLHQWV DQG LQ KLJK TXDQWLWLHV ,Q IDFW VSDP LV HFRQRPLFDOO\
YLDEOH WR LWV VHQGHUV QRW RQO\ EHFDXVH LW LV ORZ FRVW WR VHQG DQ HPDLO EXW DOVR EHFDXVH
VSDPPHUV KDYH QR RSHUDWLQJ FRVWV EH\RQG WKH PDQDJHPHQW RI WKHLU PDLOLQJ OLVWV 7KLV
DWWUDFWV QXPHURXV VSDPPHUV DQG WKH YROXPH RI XQVROLFLWHG PDLO KDV EHFRPH YHU\ KLJK
)LQDOO\ VSDP PHVVDJHV DUH XQVROLFLWHG WKDW LV WKH LQGLYLGXDOV UHFHLYLQJ VSDP ZRXOG
RWKHUZLVHQRWKDYHRSWHGWRUHFHLYHLW
7RVXFFHVVIXOO\VHQGDVSDPPHVVDJHVSDPPHUVXVXDOO\XQGHUWDNHWZRVWHSVFROOHFWLQJ
WDUJHWHPDLODGGUHVVHVDQGE\SDVVLQJDQWLVSDPPHDVXUHV6FKU\HQ7KHODWHUWDVN
LQYROYHV FOHYHUO\ GLVJXLVLQJ DQ XQVROLFLWHG PHVVDJH DV D QRQVSDP PHVVDJH ZLWK QRUPDO
DSSHDULQJVXEMHFWOLQHVDQGRWKHUZD\VRIJHWWLQJDURXQGDQWLVSDPVRIWZDUH7KHILUVWWDVN
VHHPV HDVLHU EXW LQ IDFW FRXOG EH YHU\ FKDOOHQJLQJ 7R FROOHFW YDOLG HPDLO DGGUHVVHV RI
SRWHQWLDOWDUJHWYLFWLPVWKHIROORZLQJWHFKQLTXHVFDQEHGHSOR\HG%D\OHU
x %X\LQJOLVWVRIDGGUHVVHVIURPVRPHFRPSDQLHVRURWKHUVSDPPHUV
x +DUYHVWLQJ HPDLO DGGUHVVHV IURP ZHE VLWHV RU 8VH1HW 1HZV SRVWV ZLWK DXWRPDWHG
SURJUDPV
x 6WHDOLQJXVHUVDGGUHVVERRNVRQFRPSURPLVHGFRPSXWHUV
x &ROOHFWLQJDGGUHVVHVYLD,QWHUQHW5HOD\&KDW,5&SURJUDPV
x *XHVVLQJ HPDLO DGGUHVVHV WKHQ VHQGLQJ HPDLO WR VHH LI LW JRHV WKURXJK 'LUHFWRU\
+DUYHVWDWWDFNV
x 8VLQJIDOVHUHDVRQVWRWULFNDXVHULQWRJLYLQJXSWKHLUHPDLODGGUHVV6RFLDO(QJLQHHULQJ
DWWDFNV
www.intechopen.com
$
7KRXJK VSDP HPDLOV DUH WURXEOHVRPH PRVW RI WKHP FDQ EH HDVLO\ UHFRJQL]HG E\ KXPDQ
XVHUVGXHWRWKHLUREYLRXVVLJQDWXUHV)RUH[DPSOHVSDPHPDLOVQRUPDOO\UHODWHWRVSHFLILF
WRSLFVVXFKDVSUHVFULSWLRQGUXJVJHWULFKTXLFNVFKHPHVILQDQFLDOVHUYLFHVTXDOLILFDWLRQV
RQOLQH JDPEOLQJ GLVFRXQWHG RU SLUDWHG VRIWZDUH +RZHYHU ZLWK D KXJH YROXPH RI VSDP
PHVVDJHVUHFHLYHGHYHU\GD\LWZRXOGQRWEHSUDFWLFDOIRUKXPDQXVHUVWRGHWHFWVSDPE\
UHDGLQJ DOO RI WKHP PDQXDOO\ )XUWKHUPRUH VSDP VRPHWLPHV FRPHV GLVJXLVHG ZLWK D
VXEMHFWOLQHWKDWUHDGVOLNHDSHUVRQDOPHVVDJHRUDQRQGHOLYHU\PHVVDJH7KLVPDNHVKLJKO\
DFFXUDWHVSDPGHWHFWLRQVRIWZDUHGHVLUDEOHIRUHQFRXQWHULQJVSDP
+ORCEVUQH5RCOOKPICPF2TGXGPVKXG6GEJPKSWGU
(YHQWKRXJKVSDPGRHVQRWWKUHDWHQRXUGDWDLQWKHVDPHZD\WKDWYLUXVHVGRLWGRHVFDXVH
EXVLQHVVHVELOOLRQVRIORVWGROODUVZRUOGZLGH6HYHUDOQHJDWLYHLPSDFWVRIVSDPDUHOLVWHGDV
IROORZ6FKU\HQ
x 6SDPLVUHJDUGHGDVSULYDF\LQYDVLRQEHFDXVHVSDPPHUVLOOHJDOO\FROOHFWYLFWLP·VHPDLO
DGGUHVVFRQVLGHUHGDVSHUVRQDOLQIRUPDWLRQ
x 8QVROLFLWHGHPDLOVLUULWDWH,QWHUQHWXVHUV
x 1RQVSDPHPDLOVDUHPLVVHGDQGRUGHOD\HG6RPHWLPHVXVHUVPD\HDVLO\RYHUORRNRU
GHOHWHFULWLFDOHPDLOVFRQIXVLQJWKHPZLWKVSDP
x 6SDPZDVWHVVWDIIWLPHDQGWKHUHE\VLJQLILFDQWO\UHGXFHHQWHUSULVHV·SURGXFWLYLW\
x 6SDPXVHVDFRQVLGHUDEO\ODUJHEDQGZLGWKDQGXVHVXSGDWDEDVHFDSDFLW\7KLVFDXVHV
VHULRXVORVVRI,QWHUQHWSHUIRUPDQFHDQGEDQGZLGWK
x 6RPHVSDPFRQWDLQVRIIHQVLYHFRQWHQW
x 6SDP PHVVDJHV FDQ FRPH DWWDFKHG ZLWK KDUPIXO FRGH LQFOXGLQJ YLUXVHV DQG ZRUPV
ZKLFKFDQLQVWDOOEDFNGRRUVLQUHFHLYHUV·V\VWHPV
x 6SDPPHUV FDQ KLMDFN RWKHU SHRSOH·V FRPSXWHUV WR VHQG XQZDQWHG HPDLOV 7KHVH
FRPSURPLVHG PDFKLQHV DUH UHIHUUHG WR DV ´]RPELH QHWZRUNV QHWZRUNV RI YLUXV RU
ZRUPLQIHFWHGSHUVRQDOFRPSXWHUVLQKRPHVDQGRIILFHVDURXQGWKHJOREH7KLVHQVXUHV
VSDPPHUV· DQRQ\PLW\ DQG PDVVLYHO\ LQFUHDVHV WKH QXPEHU RI VSDP PHVVDJHV FDQ EH
VHQW
9DULRXV FRXQWHUPHDVXUHV WR VSDP KDYH EHHQ SURSRVHG WR PLWLJDWH WKH LPSDFWV RI
XQVROLFLWHGHPDLOVUDQJLQJIURPUHJXODWRU\WRWHFKQLFDODSSURDFKHV7KRXJKDQWLVSDPOHJDO
PHDVXUHVDUHJUDGXDOO\EHLQJDGRSWHGWKHLUHIIHFWLYHQHVVLVVWLOOYHU\OLPLWHG$PRUHGLUHFW
FRXQWHUPHDVXUH LV VRIWZDUHEDVHG DQWLVSDP ILOWHUV ZKLFK DWWHPSW WR GHWHFW VSDP IURP
OHJLWLPDWH PDLOV DXWRPDWLFDOO\ 0RVW RI WKH H[LVWLQJ HPDLO VRIWZDUH SDFNDJHVDUH HTXLSSHG
ZLWK VRPH IRUP RI SURJUDPPDEOH VSDP ILOWHULQJ FDSDELOLW\ W\SLFDOO\ LQ WKH IRUP RI
EODFNOLVWVRINQRZQVSDPPHUVLHEORFNHPDLOVWKDWFRPHIURPDEODFNOLVWFKHFNZKHWKHU
HPDLOVFRPHIURPDJHQXLQHGRPDLQQDPHRUZHEDGGUHVVDQGKDQGFUDIWHGUXOHVLHEORFN
PHVVDJHV FRQWDLQLQJ VSHFLILF NH\ZRUGV DQG XQQHFHVVDU\ HPEHGGHG +70/ FRGH %HFDXVH
VSDPPHUV QRUPDOO\ XVH IRUJHG DGGUHVVHV WKH EODFNOLVW DSSURDFK LV YHU\ LQHIIHFWLYH
+DQGFUDIWHG UXOHV DUH DOVR OLPLWHG GXH WR WKHLU UHOLDQFH RQ SHUVRQDO SUHIHUHQFHV LH WKH\
QHHG WR EH WXQHG WR FKDUDFWHULVWLFV RI PHVVDJHV UHFHLYHG E\ D SDUWLFXODU XVHU RU JURXSV RI
XVHUV 7KLV LV D WLPH FRQVXPLQJ WDVN UHTXLULQJ UHVRXUFHV DQG H[SHUWLVH DQG KDV WR EH
UHSHDWHG SHULRGLFDOO\ WR DFFRXQW IRU FKDQJLQJ QDWXUH RI VSDP PHVVDJHV / ) &UDQRU
/D0DFFKLD%$
6SDPGHWHFWLRQLVFORVHO\UHODWHGWR7H[W&DWHJRUL]DWLRQ7&GXHWRWKHLUWH[WEDVHGFRQWHQWV
DQGVLPLODUWDVNV+RZHYHUXQOLNHPRVW7&SUREOHPVVSDPPLQJLVWKHDFWRIEOLQGO\PDVV
www.intechopen.com
%
PDLOLQJ DQ XQVROLFLWHG PHVVDJH WKDW PDNHV LW VSDP QRW LWV DFWXDO FRQWHQW 6FKU\HQ DQ\RWKHUZLVHOHJLWLPDWHPHVVDJHEHFRPHVVSDPLIEOLQGO\PDVVPDLOHG)URPWKLVSRLQWRI
YLHZ VSDPPLQJ EHFRPHV D YHU\ FKDOOHQJLQJ SUREOHP WR WKH VXVWDLQDELOLW\ RI WKH ,QWHUQHW
JLYHQ WKH FRQWHQW RI HPDLOV WKH RQO\ IRXQGDWLRQ IRU VSDP UHFRJLQLWLRQ 1HYHUWKHOHVV LW
VHHPVWKDWWKHODQJXDJHRIFXUUHQWVSDPPHVVDJHVFRQVWLWXWHVDGLVWLQFWLYHJHQUHDQGWKDW
WKH WRSLFV RI PRVW FXUUHQW VSDP PHVVDJHV DUH UDUHO\ PHQWLRQHG LQ OHJLWLPDWH PHVVDJHV
PDNLQJLWSRVVLEOHWRWUDLQVXFFHVVIXOO\DWH[WFODVVLILHUIRUVSDPUHFRJQLWLRQ
/CEJKPG.GCTPKPIHQT5RCO4GEQIPKVKQP
5HFHQW DGYDQFHV RI 0DFKLQH /HDUQLQJ 0/ WHFKQLTXHV LQ 7H[W &ODVVLILFDWLRQ 7& KDYH
DWWUDFWHG LPPHQVH DWWHQWLRQ IURP UHVHDUFKHUV WR H[SORUH WKH DSSOLFDELOLW\ RI OHDUQLQJ
DOJRULWKPV LQ DQWLVSDP ILOWHULQJ %D\OHU ,Q SDUWLFXODU D FROOHFWLRQ RI PHVVDJHV LV
LQSXW WR D OHDUQLQJ DOJRULWKPZKLFKLQIHUV XQGHUO\LQJ IXQFWLRQDO GHSHQGHQFLHV RI UHOHYDQW
IHDWXUHV7KHUHVXOWRIWKLVSURFHVVLVDPRGHOWKDWFDQZLWKRXWKXPDQLQWHUYHQWLRQFODVVLI\
DQHZLQFRPLQJHPDLODVVSDPRUOHJLWLPDWHDFFRUGLQJWRWKHNQRZOHGJHFROOHFWHGIURPWKH
WUDLQLQJVWDJH$SDUWIURPDXWRPDWLRQZKLFKIUHHVRUJDQL]DWLRQVIURPWKHQHHGRIPDQXDOO\
FODVVLI\LQJ D KXJH DPRXQW RI PHVVDJHV WKLV PRGHO FDQ EH UHWDLQHG WR FDSWXUH QHZ
FKDUDFWHULVWLFVRIVSDPHPDLOV7REHPRVWXVHIXOLQUHDOZRUOGDSSOLFDWLRQVWKHDQWLVSDP
ILOWHUV QHHG WR KDYH D JRRG JHQHUDOL]DWLRQ FDSDELOLW\ WKDW LV WKH\ FDQ GHWHFW PDOLFLRXV
PHVVDJHV ZKLFK QHYHU RFFXU GXULQJ WKH OHDUQLQJ SURFHVV 7KHUH KDV EHHQ D JUHDW GHDO RI
UHVHDUFKFRQGXFWHGLQWKLVDUHDUDQJLQJIURPVLPSOHPHWKRGVVXFKDVSURSRVLWLRQDOOHDUQHU
5LSSHUZLWK´NH\ZRUGVSRWWLQJUXOHVµ&RKHQWRPRUHFRPSOLFDWHGDSSURDFKHVVXFK
DV%D\HVLDQQHWZRUNVXVLQJEDJVRIZRUGVUHSUHVHQWDWLRQDQGELQDU\FRGLQJ6DKDPL
,Q $QGURXWVRSRXORV .RXWVLDV &KDQGULQRV 3DOLRXUDV 6S\URSRXORV D V\VWHP
LPSOHPHQWLQJ1DwYH%D\HVDQGDN11WHFKQLTXHLVUHSRUWHGWREHDEOHWRRXWSHUIRUPWKH
NH\ZRUGEDVHG ILOWHU RI 2XWORRN RQ WKH /LQJ6SDP FRUSXV (QVHPEOH PHWKRGV DOVR
SURYH WKHLU XVHIXOQHVV LQ ILOWHULQJ VSDP )RU H[DPSOH VWDNHG 1DwYH %D\HV DQG N11 FDQ
DFKLHYH JRRG DFFXUDF\ 'UXFNHU :X 9DSQLN DQG %RRVWHG WUHHV ZHUH VKRZQ WR
KDYH EHWWHU SHUIRUPDQFH WKDQ LQGLYLGXDO WUHHV 1DwYH %D\HV DQG N11 DORQH &DUUHUDV 0DUTXH]$VXSSRUWYHFWRUPDFKLQH690'UXFNHUHWDOLVDOVRUHSRUWHGWR
DFKLHYH D KLJKHU GHWHFWLRQ UDWH DV ZHOO DV ORZHU IDOVH DODUP UDWH IRU VSDP UHFRJQLWLRQ
FRPSDUHG ZLWK RWKHU GLVFULPLQDWLYH FODVVLILFDWLRQ PHWKRGV ,W LV VXJJHVWHG WKDW HPDLO
KHDGHUVSOD\DYLWDOUROHLQVSDPUHFRJQLWLRQDQGWRJHWEHWWHUUHVXOWVFODVVLILHUVVKRXOGEH
WUDLQHGRQIHDWXUHVRIERWKHPDLOKHDGHUVDQGHPDLOERGLHV$QGURXWVRSRXORVHWDO
.KPI5RCO$GPEJOCTM
7KH /LQJ6SDP FRUSXV $QGURXWVRSRXORV HW DO LV XVHG DV D EHQFKPDUN WR HYDOXDWH
RXUSURSRVHGDOJRULWKPZLWKRWKHUH[LVWLQJWHFKQLTXHVWKHDQWLVSDPILOWHULQJWDVN8VLQJ
WKLV SXEOLFO\ DYDLODEOH GDWDVHW ZH FDQ FRQGXFW WUDFWDEOH H[SHULPHQWV DQG DOVR DYRLG
FRPSOLFDWLRQVRISULYDF\LVVXHV:KLOHVSDPPHVVDJHVGRQRWSRVHWKLVSUREOHPDVWKH\DUH
EOLQGO\GLVWULEXWHGWRDODUJHQXPEHURIUHFLSLHQWVOHJLWLPDWHHPDLOPHVVDJHVPD\FRQWDLQ
SHUVRQDOLQIRUPDWLRQDQGFDQQRWXVXDOO\EHUHOHDVHGZLWKRXWYLRODWLQJWKHSULYDF\RIWKHLU
UHFLSLHQWVDQGVHQGHUV
www.intechopen.com
&
7KH FRUSXV FRQWDLQV OHJLWLPDWH PHVVDJHV FROOHFWHG IURP D PRGHUDWHG PDLOLQJ OLVW RQ
SURIHVVLRQ DQG VFLHQFH RI OLQJXLVWLFV DQG WKH VSDP PHVVDJHV FROOHFWHG IURP SHUVRQDO
PDLOER[HV
x OHJLWLPDWHPHVVDJHVZLWKWH[WDGGHGE\WKHOLVW·VVHUYHUUHPRYHG
x VSDPPHVVDJHVGXSOLFDWHVSDPPHVVDJHVUHFHLYHGRQWKHVDPHGD\H[FOXGHG
7KHKHDGHUV+70/WDJVDQGDWWDFKPHQWVRIWKHVHPHVVDJHVDUHUHPRYHGOHDYLQJRQO\WKH
VXEMHFWOLQHDQGERG\WH[W7KHGLVWULEXWLRQRIWKHGDWDVHWLVVSDPPDNHVLWHDV\WR
LGHQWLI\ OHJLWLPDWH HPDLOV EHFDXVH RI WKH WRSLFVSHFLILF QDWXUH RI WKH OHJLWLPDWH PDLOV 7KLV
GDWDVHWLVSDUWLWLRQHGLQWRVWUDWLILHGVXEVHWVZKLFKPDLQWDLQWKHVDPHUDWLRRIOHJLWLPDWH
DQGVSDPPHVVDJHVDVLQWKHHQWLUHGDWDVHW7KRXJKVRPHUHVHDUFK$QGURXWVRSRXORVHWDO
&DUUHUDV 0DUTXH] +VX &KDQJ /LQ 6DNNLV HW DO KDV EHHQ
FRQGXFWHGRQWKLVGDWDVKRZLQJWKHLUFRPSDUDWLYHHIILFLHQF\PRVWRIWKHPVXIIHUIURPKLJK
DIDOVHDODUPUDWHZKLFKUHVXOWVLQDGHJUDGHGSHUIRUPDQFHZKHQWKHPLVFODVVLILFDWLRQFRVWLV
KLJK2YHUFRPLQJWKLVSUREOHPLVRXUPDMRUREMHFWLYHLQWKLVFKDSWHU
5RCO4GEQIPKVKQP/GVJQFU
7KLVVHFWLRQGLVFXVVHVFRPPRQO\XVHGOHDUQLQJDOJRULWKPVIRUVSDPUHFRJQLWLRQSUREOHPV
0CÊXG$C[GU
1DLYH %D\HV LV D ZHOONQRZQ SUREDELOLVWLF FODVVLILFDWLRQ DOJRULWKP ZKLFK KDV EHHQ XVHG
ZLGHO\ IRU VSDP UHFRJQLWLRQ $QGURXWVRSRXORV HW DO $FFRUGLQJ WR %D\HV
WKHRUHP
WKDW D PHVVDJH ZLWK YHFWRU
ZH FDQ FRPSXWH WKH SUREDELOLW\
EHORQJVWRDFODVV
LV SUREOHPDWLF EHFDXVH PRVW DOO QRYHO PHVVDJHV DUH
7KH FDOFXODWLRQ RI
GLIIHUHQWIURPWUDLQLQJPHVVDJHV7KHUHIRUHLQVWHDGRIFDOFXODWLQJSUREDELOLW\IRUPHVVDJHV
D FRPELQDWLRQ RI ZRUGV ZH FDQ FRQVLGHU WKHLU ZRUGV VHSDUDWHO\ %\ PDNLQJ WKH
DVVXPSWLRQWKDW
DUHFRQGLWLRQDOO\LQGHSHQGHQWJLYHQWKHFODVVFZHKDYH
/GOQT[$CUGF.GCTPKPI
,Q $QGURXWVRSRXORV HW DO DQ DQWLVSDP ILOWHULQJ WHFKQLTXH XVLQJ 0HPRU\%DVHG
/HDUQLQJ 0%/ WKDW VLPSO\ VWRUHV WKH WUDLQLQJ PHVVDJHV 7KH WHVW PHVVDJHV DUH WKHQ
FODVVLILHGE\HVWLPDWLQJWKHLUVLPLODULW\WRWKHVWRUHGH[DPSOHVEDVHGRQWKHLURYHUODSPHWULF
ZKLFK FRXQWV WKH DWWULEXWHV ZKHUH WKH WZR PHVVDJHV KDYH GLIIHUHQW YDOXHV *LYHQ WZR
DQG
WKHLURYHUODSGLVWDQFHLV
LQVWDQFHV
:KHUH
www.intechopen.com
LI[ \RURWKHUZLVH
'
7KHFRQILGHQFHOHYHOWKDWDPHVVDJH EHORQJVWRDFODVVFLVFDOFXODWHGEDVHGRQWKHFODVVHV
RIRWKHUQHLJKERULQVWDQFHV
0%/·VSHUIRUPDQFHFDQEHVLJQLILFDQWO\LPSURYHGE\LQWURGXFLQJVRPHZHLJKWLQJVFKHPHV
&KUVCPEG9GKIJVKPI
'HSHQGLQJRQKRZIDUDWHVWLQVWDQFHLVDZD\IURPLWVQHLJKERUKRRGLWV·FRQILGHQFHOHYHOLV
HVWLPDWHG
#VVTKDWVG9GKIJVKPI
8QOLNH WKH EDVLF NQHLJKERUKRRG FODVVLILHUV ZKHUH DOO DWWULEXWHV DUH WUHDWHG HTXDOO\ 0%/
DVVLJQV GLIIHUHQW ZHLJKWV WR WKH DWWULEXWHV GHSHQGLQJ RQ KRZ ZHOO WKH\ GLVFULPLQDWH
EHWZHHQWKHFDWHJRULHVDQGDGMXVWWKHGLVWDQFHPHWULFDFFRUGLQJO\,QSDUWLFXODUDQDWWULEXWH
KDVDZHLJKWRI ZKLFKLVWKHUHGXFWLRQRIHQWURS\+&XQFHUWDLQW\RQDQ\FDWHJRU\&
RIDUDQGRPO\VHOHFWHGLQVWDQFHDQGWKHH[SHFWHGYDOXHRIHQWURS\
XQFHUWDLQO\
RQ DQ\ FDWHJRU\ & JLYHQ WKH YDOXH RI DWWULEXWH ; 7KLV PHDQV DQ DWWULEXWH ZRXOG KDYH D
KLJKHUZHLJKWLINQRZLQJLWVYDOXHUHGXFHVXQFHUWDLQW\RQFDWHJRU\&
:KHUH
7KHGLVWDQFHEHWZHHQWZRLQVWDQFHVLVUHFDOFXODWHGDVEHORZ
$QQUVGF&GEKUKQP6TGG
%RRVWHG 7UHH %7 LV D SRSXODU PHWKRG LPSOHPHQWHG LQ PDQ\ DQWLVSDP ILOWHUV ZLWK JUHDW
VXFFHVVHV&DUUHUDV0DUTXH],WXVHVWKH$'$%RRVWDOJRULWKP6FKDSLUH6LQJHU
WR JHQHUDWH D QXPEHU RI 'HFLVLRQ 7UHVV FODVVLILHUV ZKLFK DUH WUDLQHG E\ GLIIHUHQW
VDPSOH VHWV GUDZQ IURP WKH RULJLQDO WUDLQLQJ VHW (DFK RI WKHVH FODVVLILHUV SURGXFHV D
K\SRWKHVLVIURPZKLFKDOHDUQLQJHUURUFDQEHFDOFXODWHG:KHQWKLVHUURUH[FHHGVDFHUWDLQ
OHYHOWKHSURFHVVLVWHUPLQDWHG$ILQDOFRPSRVLWHK\SRWKHVLVLVWKHQFUHDWHGE\FRPELQLQJ
LQGLYLGXDOK\SRWKHVHV
5WRRQTV8GEVQT/CEJKPG
6XSSRUW 9HFWRU 0DFKLQHV 690 'UXFNHU HW DO KDYH EHFRPH RQH RI WKH SRSXODU
WHFKQLTXHV IRU WH[W FDWHJRUL]DWLRQ WDVNV GXH WR WKHLU JRRG JHQHUDOL]DWLRQ QDWXUH DQG WKH
DELOLW\ WR RYHUFRPH WKH FXUVH RI GLPHQVLRQDOLW\ 690 FODVVLILHV GDWD E\ D VHW RI
UHSUHVHQWDWLYH VXSSRUW YHFWRUV $VVXPH WKDW ZH ZDQW WR ILQG D GLVFULPLQDQW IXQFWLRQ I[
VXFK WKDW
$ SRVVLEOH OLQHDU GLVFULPLQDQW IXQFWLRQ FDQ EH SUHVHQWHG DV
www.intechopen.com
()
ZKHUH
LV D VHSDUDWLQJ K\SHUSODQH LQ WKH GDWD VSDFH
&RQVHTXHQWO\ FKRRVLQJ D GLVFULPLQDQW IXQFWLRQ LV WR ILQG D K\SHUSODQH KDYLQJ WKH
PD[LPXPVHSDUDWLQJPDUJLQZLWKUHVSHFWWRWKHWZRFODVVHV$690PRGHOLVFRQVWUXFWHG
E\VROYLQJWKLVRSWLPL]DWLRQSUREOHP
#TVKHKEKCN0GWTCN0GVYQTM
$UWLILFLDOQHXUDOQHWZRUN$11KDVJDLQHGVWURQJLQWHUHVWVIURPGLYHUVHFRPPXQLWLHVGXH
WRLWVDELOLW\WRLGHQWLI\WKHSDWWHUQVWKDWDUHQRWUHDGLO\REVHUYDEOH0XOWL/D\HU3HUFHSWURQ
0/3 LV WKH PRVW SRSXODU QHXUDO QHWZRUN DUFKLWHFWXUH LQ XVH WRGD\ 7KLV QHWZRUN XVHV D
OD\HUHG IHHGIRUZDUG WRSRORJ\ LQ ZKLFK WKH XQLWV HDFK SHUIRUP D ELDVHG ZHLJKWHG VXPRI
WKHLU LQSXWV DQG SDVV WKLV DFWLYDWLRQ OHYHO WKURXJK D WUDQVIHU IXQFWLRQ WR SURGXFH WKHLU
RXWSXW5XPHOKDUW0F&OHOODQG7KRXJKPDQ\DSSOLFDWLRQVKDYHLPSOHPHQWHG0/3
IRUVXSHULRUOHDUQLQJFDSDFLW\LWVSHUIRUPDQFHLVXQUHOLDEOHZKHQQHZGDWDLVHQFRXQWHUHG
$ UHFHQWO\ HPHUJLQJ EUDQFK RI $11 WKH 5%) QHWZRUNV LV DOVR UHSRUWHG WR JDLQ JUHDW
VXFFHVVHV LQ GLYHUVH DSSOLFDWLRQV ,Q WKLV FKDSWHU 0/3 LV LPSOHPHQWHG DV W\SLFDO $11
PRGHOVIRUVSDPUHFRJQLWLRQ
%NCUUKHKECVKQP(TCOGYQTMHQT5RCO4GEQIPKVKQP
$OWKRXJK OHWWLQJ XQGHWHFWHG VSDP SDVV WKURXJK D ILOWHU LV QRW DV GDQJHURXV DV EORFNLQJ D
OHJLWLPDWHPHVVDJHRQHFDQDUJXHWKDWDPRQJRQHPLOOLRQLQFRPLQJHPDLOVDIHZWKRXVDQG
XQVROLFLWHG PHVVDJH WKDW DUH PLVFODVVLILHG DV QRUPDO LV VWLOO YHU\ FRVWO\ +HQFH DQWLVSDP
ILOWHUV UHDOO\ QHHG WR EH DFFXUDWH HVSHFLDOO\ ZKHQ WKH\ DUH XVHG LQ ODUJH RUJDQL]DWLRQV
$GYDQFHG 0/ WHFKQLTXHV KDYH EHHQ XVHG WR LPSURYH SHUIRUPDQFH RI VSDP ILOWHULQJ
V\VWHPV$PRQJVWWKRVHPHWKRGV$UWLILFLDO1HXUDO1HWZRUN$11KDVEHHQJDLQLQJVWURQJ
LQWHUHVWV IURP GLYHUVH FRPPXQLWLHV GXH WR LWV DELOLW\ WR LGHQWLI\ WKH SDWWHUQV WKDW DUH QRW
UHDGLO\ REVHUYDEOH 'HVSLWH UHFHQW VXFFHVVHV $11 EDVHG DSSOLFDWLRQV VWLOO KDYH VRPH
GLVDGYDQWDJHVVXFKDVH[WHQVLYHFRPSXWDWLRQDQGXQUHOLDEOHSHUIRUPDQFH,QWKLVVWXG\ZH
XVH D 0RGLILHG 3UREDELOLVWLF 1HXUDO 1HWZRUN 0311 ZKLFK LV GHYHORSHG E\ =DNQLFK
=DNQLFK
,I WKHUH H[LVWV D FRUUHVSRQGLQJ VFDODU RXWSXW IRU HDFK ORFDO UHJLRQ FOXVWHU ZKLFK LV
UHSUHVHQWHGE\DFHQWHUYHFWRU 0311FDQEHPRGHOHGDVIROORZ=DNQLFK
:LWK*DXVVLDQIXQFWLRQ
:KHUH
FHQWHUYHFWRUIRUFOXVWHULLQWKHLQSXWVSDFH
VFDODURXWSXWUHODWHGWR QXPEHURILQSXWYHFWRUV ZLWKLQFOXVWHU VLQJOHVPRRWKLQJSDUDPHWHUFKRVHQGXULQJQHWZRUNWUDLQLQJ
0 QXPEHURIXQLTXHFHQWHUV 7KRXJK0311LVUHSRUWHGWRSURYLGHDFFHSWDEOHDFFXUDF\DQGDIIRUGDEOHFRPSXWDWLRQLW
MXVWOLNHRWKHU$11FDQQRWFODVVLI\UHOLDEO\ZKHQDQXQXVXDOLQSXWZKLFKGLIIHUVIURPWKHLU
WUDLQLQJGDWDHPHUJHV$VDUHVXOWLWLVHVVHQWLDOWKDWVRPHGHJUHHRIJHQHUDOL]DWLRQFDSDFLW\
www.intechopen.com
(
PXVWEHLQFRUSRUDWHGLQWKH0311EDVHGFODVVLILHUV$SRVVLEOHDSSURDFKWRWKLVSUREOHPLV
WR LQFRUSRUDWH 0311 ZLWK D OLQHDU PRGHO ZKLFK RIIHUV VWDELOLW\ DQDO\]DELOLW\ DQG IDVW
DGDSWDWLRQ+D\HV
&GUETKRVKQP
)LJXUH VKRZV WKH RYHUDOO ILOWHULQJ IUDPHZRUN SURSRVHG IRU VSDP UHFRJQLWLRQ SUREOHP
7KHUHDUHPDLQSKDVHV
)LJ3URSRVHGDQWLVSDPILOWHULQJIUDPHZRUN
2JCUG&CVC4GRTGUGPVCVKQPCPF2TGRTQEGUUKPI
7KH SXUSRVH RI GDWD SUHSURFHVVLQJ LV WR WUDQVIRUP PHVVDJHV LQ WKH PDLO FRUSXV LQWR D
XQLIRUPIRUPDWWKDWFDQEHXQGHUVWRRGE\WKHOHDUQLQJDOJRULWKPV)HDWXUHVIRXQGLQPDLOV
DUH QRUPDOO\ WUDQVIRUPHG LQWR D YHFWRU VSDFH LQ ZKLFK HDFK GLPHQVLRQ RI WKH VSDFH
FRUUHVSRQGV WR D JLYHQ IHDWXUH LQ WKH HQWLUH FRUSXV (DFK LQGLYLGXDO PHVVDJH FDQ WKHQ EH
YLHZHGDVDIHDWXUHYHFWRU7KLVLVUHIHUUHGWRDVWKH´EDJRIZRUGVµDSSURDFK7KHUHDUHWZR
PHWKRGVWRUHSUHVHQWHOHPHQWVRIWKHIHDWXUHYHFWRU PXOWLYDULDWHSUHVHQWDWLRQDVVLJQVD
ELQDU\YDOXHWRHDFKHOHPHQWVKRZLQJWKDWWKHZRUGRFFXUVLQWKHFXUUHQWPDLORUQRWDQG
PXOWLQRPLDO SUHVHQWDWLRQ UHSUHVHQWV HDFK HOHPHQW DV D QXPEHU WKDW VKRZV WKH RFFXUUHQFH
IUHTXHQF\ RI WKDW ZRUG LQ WKH FXUUHQW PDLO $ FRPELQDWLRQ RI ´EDJ RI ZRUGVµ DQG PXOWL
YDULDWH SUHVHQWDWLRQ LV XVHG LQ RXU H[SHULPHQWV WKH RUGHU RI WKH ZRUGV LV QHJOHFWHG 7R
FRQVWUXFW WKH IHDWXUH YHFWRUV WKH LPSRUWDQW ZRUGV DUH VHOHFWHG DFFRUGLQJ WR WKHLU 0XWXDO
,QIRUPDWLRQ0,6DNNLVHWDO
www.intechopen.com
((
7KHZRUGVZLWKWKHKLJKHVW0,YDOXHVDUHVHOHFWHGDVWKHIHDWXUHV$VVXPHWKDWWKHUHDUHQ
IHDWXUHVWREHFKRVHQHDFKPDLOZLOOEHUHSUHVHQWHGE\DIHDWXUHYHFWRU
ZKHUH
DUHWKHYDOXHVRIELQDU\DWWULEXWHV
LQGLFDWLQJWKHSUHVHQFHRUDEVHQFHRI
DQDWWULEXWHZRUGLQFXUUHQWPHVVDJH
0RUHRYHU ZRUG VWHPPLQJ DQG VWRSZRUG UHPRYDO DUH WZR LPSRUWDQW LVVXHV WKDW QHHG WR EH
FRQVLGHUHG LQ SDUVLQJ HPDLOV :RUG VWHPPLQJ UHIHUV WR FRQYHUWLQJ ZRUGV WR WKHLU
PRUSKRORJLFDO EDVH IRUPV HJ ´JRQHµ DQG ´ZHQWµ DUH UHGXFHG WR URRW ZRUG ´JRµ 6WRS
ZRUG UHPRYDO LV D SURFHGXUH WR UHPRYH ZRUGV WKDW DUH IRXQG LQ D OLVW RI IUHTXHQWO\ XVHG
ZRUGV VXFK DV ´DQG IRU Dµ7KH PDLQ DGYDQWDJHV RI DSSO\LQJ WKH WZR WHFKQLTXHV DUH WKH
UHGXFWLRQ RI IHDWXUH VSDFH GLPHQVLRQ DQG SRVVLEOH LPSURYHPHQW RQ FODVVLILHUV· SUHGLFWLRQ
DFFXUDF\ E\ DOOHYLDWLQJ WKH GDWD VSDUVHQHVV SUREOHP$QGURXWVRSRXORV HW DO 7KH
/LQJ6SDP FRUSXV KDV IRXU YHUVLRQV HDFK GLIIHUV IURP HDFK RWKHU E\ WKH XVDJH RI D
OHPPDWL]HUDQGDVWRSOLVWUHPRYHVWKHPRVWIUHTXHQWO\XVHGZRUGV:HXVHWKHYHUVLRQ
ZLWK OHPPDWL]HU DQG VWRSOLVW HQDEOHG EHFDXVH LW SHUIRUPV EHWWHU ZKHQ GLIIHUHQW FRVW
VFHQDULRVDUHFRQVLGHUHG$QGURXWVRSRXORVHWDO:RUGVWKDWDSSHDUOHVVWKDQWLPHV
RUORQJHUWKDQFKDUDFWHUVDUHGLVFDUGHG
$OVR LW LV IRXQG WKDW SKUDVDO DQG QRQWH[WXDO DWWULEXWHV PD\ LPSURYH VSDP UHFRJQLWLRQ
SHUIRUPDQFH $QGURXWVRSRXORV HW DO +RZHYHU WKH\ LQWURGXFH D PDQXDO
FRQILJXUDWLRQSKDVH%HFDXVHRXUWDUJHWZDVWRH[SORUHIXOO\DXWRPDWLFDQWLVSDPILOWHULQJ
ZHOLPLWHGRXUVHOYHVWRZRUGRQO\DWWULEXWHV
)LQDOO\ VRPH GDWD FOHDQLQJ WHFKQLTXHV DUH UHTXLUHG DIWHU FRQYHUWLQJ UDZ GDWD LQWR
DSSURSULDWH IRUPDW ,Q SDUWLFXODU WR GHDO ZLWK PLVVLQJ YDOXHV WKH VLPSOHVW DSSURDFK LV WR
GHOHWH DOO LQVWDQFHV ZKHUH WKHUH LV DW OHDVW RQH PLVVLQJ YDOXH DQG XVH WKH UHPDLQGHU 7KLV
VWUDWHJ\KDVWKHDGYDQWDJHRIDYRLGLQJLQWURGXFLQJDQ\GDWDHUURUV,WVPDLQSUREOHPLVWKDW
GLVFDUGRIGDWDPDQ\GDPDJHWKHUHOLDELOLW\RIWKHUHVXOWLQJFODVVLILHU0RUHRYHUWKHPHWKRG
FDQQRWEHXVHGZKHQDKLJKSURSRUWLRQRILQVWDQFHVLQWKHWUDLQLQJVHWKDYHPLVVLQJYDOXHV
7RJHWKHU WKHVH ZHDNQHVVHV DUH TXLWH VXEVWDQWLDO $OWKRXJK LW PD\ EH ZRUWK WU\LQJ ZKHQ
WKHUH DUH IHZ PLVVLQJ YDOXHV LQ WKH GDWDVHW WKLV DSSURDFK LV JHQHUDOO\ QRW UHFRPPHQGHG
,QVWHDGZHXVHDQDOWHUQDWLYHVWUDWHJ\LQZKLFKDQ\PLVVLQJYDOXHVRIDFDWHJRULFDODWWULEXWH
DUH UHSODFHG E\ LWV PRVW FRPPRQO\ RFFXUULQJ YDOXH LQ WKH WUDLQLQJ VHW )RU FRQWLQXRXV
DWWULEXWHVPLVVLQJYDOXHVDUHUHSODFHGE\LWVDYHUDJHYDOXHLQWKHWUDLQLQJVHW
2JCUG(GCVWTG6TCPUHQTOCVKQP
7KH WUHPHQGRXV JURZWK LQ FRPSXWLQJ SRZHU DQG VWRUDJH FDSDFLW\ KDV PDGH WRGD\·V
GDWDEDVHV HVSHFLDOO\ IRU WH[W FDWHJRUL]DWLRQ WDVNV FRQWDLQ YHU\ ODUJH QXPEHU RI DWWULEXWHV
$OWKRXJK IDVWHU SURFHVVLQJ VSHHGV DQG ODUJHU PHPRULHV PD\ PDNH LW SRVVLEOH WR SURFHVV
WKHVH DWWULEXWHV WKLV LV LQHYLWDEO\ D ORVLQJ VWUXJJOH LQ WKH ORQJ WHUP %HVLGHV GHJUDGHG
SHUIRUPDQFH PDQ\ LUUHOHYDQW DWWULEXWHV ZLOO DOVR SODFH DQ XQQHFHVVDU\ FRPSXWDWLRQDO
RYHUKHDG RQ DQ\ GDWD PLQLQJ DOJRULWKP 7KHUH DUH VHYHUDO ZD\V LQ ZKLFK WKH QXPEHU RI
DWWULEXWHVFDQEHUHGXFHGEHIRUHDGDWDVHWLVSURFHVVHG,QWKLVUHVHDUFKDGLPHQVLRQUHGXFWLRQ
DOVR FDOOHG IHDWXUH SUXQLQJ RU IHDWXUH VHOHFWLRQ VFKHPH FDOOHG 3ULQFLSDO &RPSRQHQW $QDO\VLV
3&$ -ROOLIIH LV SHUIRUPHG RQ WKH GDWD WR VHOHFW WKH PRVW UHOHYDQW IHDWXUHV 7KLV LV
QHFHVVDU\ JLYHQ WKH YHU\ ODUJH VL]H DQG FRUUHODWHG QDWXUH RI WKH LQSXW YHFWRUV 3&$
www.intechopen.com
(
HOLPLQDWHV KLJKO\ FRUUHODWHG IHDWXUHV DQG WUDQVIRUPV WKH RULJLQDO GDWD LQWR ORZHU
GLPHQVLRQDO GDWD ZLWK PRVW UHOHYDQW IHDWXUHV )URP RXU REVHUYDWLRQ WKH VHOHFWHG IHDWXUHV
DUH ZRUGV WKDW H[SUHVV WKH GLVWLQFWLRQ EHWZHHQ VSDP DQG QRQVSDP JURXSV LH WKH\ DUH
HLWKHUFRPPRQLQVSDPRUOHJLWLPDWHPHVVDJHVQRWLQERWK6HYHUDOSXQFWXDWLRQDQGVSHFLDO
V\PEROV HJ ´µ ´#µ DUH DOVR VHOHFWHG E\ 3&$ DQG WKHUHIRUH WKH\ DUH QRW HOLPLQDWHG
GXULQJSUHSURFHVVLQJ
2JCUG'OCKN%NCUUKHKECVKQP
7KH GDWD DIWHU EHLQJ SURFHVVHG E\ WKH )HDWXUH VHOHFWLRQ PRGXOH LV LQSXW WR WUDLQ WKH
&ODVVLILFDWLRQ 0RGHO 7KH UHVXOWLQJ PRGHO LV WKHQ XVHG WR ODEHO HPDLOV DV HLWKHU ´OHJLWµ RU
´VSDPµ LQGLFDWLQJ ZKHWKHU D PHVVDJH LV FODVVLILHG DV OHJLWLPDWH RU D VSDP HPDLO 7R
LPSOHPHQWWKH&ODVVLILFDWLRQ0RGHOZHSURSRVHDQLQWHOOLJHQWZD\RIFRPELQLQJWKHOLQHDU
SDUW RI WKH PRGHOLQJ ZLWK D VLPSOH QRQOLQHDU PRGHO DOJRULWKP ,Q SDUWLFXODU 0311 LV
DGDSWHGLQ WKH QRQOLQHDU FRPSHQVDWRUZKLFK ZLOO RQO\ PRGHO KLJKHU RUGHUHG FRPSOH[LWLHV
ZKLOH OLQHDU PRGHO ZLOO GRPLQDWH LQ FDVH RI GDWD IDU DZD\ IURP WUDLQLQJ FOXVWHUV ,W LV
GHVFULEHGLQWKHIROORZLQJHTXDWLRQ
:KHUH
/LQHDU5HJUHVVLRQ0RGHO
1RQOLQHDU5HVLGXDO&RPSHQVDWRU0311
LQLWLDORIIVHW
ZHLJKWVRIWKHOLQHDUPRGHO
&RPSHQVDWLRQIDFWRU
GLIIHUHQFH EHWZHHQ WKH OLQHDU DSSUR[LPDWLRQ DQG WKH WUDLQLQJ
RXWSXW
GLVWDQFHIURPWKHLQSXWYHFWRUWRFOXVWHULLQWKHLQSXWVSDFH
7KHFRPELQDWLRQRIOLQHDUUHJUHVVLRQPRGHODQG0311LVUHIHUUHGWRDV/LQHDU5HJUHVVLRQ²
0RGLILHG3UREDELOLVWLF1HXUDO1HWZRUN/503117KHSLHFHZLVHOLQHDUUHJUHVVLRQPRGHO
LV ILUVWO\ DSSUR[LPDWHG E\ XVLQJ DOO DYDLODEOH WUDLQLQJ GDWD LQ D VLPSOH UHJUHVVLRQ ILWWLQJ
DQDO\VLV7KH0311LVWKHQFRQVWUXFWHGWRFRPSHQVDWHIRUKLJKHURUGHUHGFKDUDFWHULVWLFVRI
WKHSUREOHP'HSHQGLQJRQGLIIHUHQWSRUWLRQVRIWKHWUDLQLQJVHWDQGKRZIDUWKHWHVWGDWDLV
DZD\IURPWKHWUDLQLQJGDWDWKHLPSDFWRIQRQOLQHDUUHVLGXDOIXQFWLRQLVDGMXVWHGVXFKWKDW
WKH RYHUDOO 0HDQ 6TXDUH (UURU LV PLQLPL]HG 7KLV DGMXVWPHQW LV IRUPXODWHG E\ WKH
FRPSHQVDWLRQ IDFWRU ,Q SDUWLFXODU LV FRPSXWHG EDVHG RQ KRZ ZHOO WKH OLQHDU PRGHO
SHUIRUPVRQDWUDLQLQJH[DPSOHVDQGGLVWDQFHVIURPDWHVWYHFWRUWRFOXVWHUVRIWUDLQLQJGDWD
RQDSDUWLFXODUWUDLQLQJGDWDLVPHDVXUHVE\
)LUVWO\WKHJRRGQHVVRIWKHOLQHDUPRGHO
ZKLFK LV GHILQHG DV WKH GLIIHUHQFH EHWZHHQ WKH OLQHDU DSSUR[LPDWLRQ DQG WKH DFWXDO
ILWVWKHGDWDZHOOLQ
RXWSXWRIWKHWUDLQLQJGDWD$YHU\VPDOOYDOXHRI PHDQVWKDW
WKLVFDVHDQGWKHUHIRUHLWVKRXOGKDYHKLJKHUSULRULW\RUWKHLPSDFWRIWKHQRQOLQHDUPRGHO
LVPLQLPL]HG,QFRQWUDVWODUJHYDOXHRI LQGLFDWHVWKDW
VKRXOGFRPSHQVDWH
PRUHIRUWKHGHJUDGHGDFFXUDF\RI
6HFRQGO\WRGHWHUPLQHKRZIDUDJLYHQWHVWYHFWRULVDZD\IURPWKHDYDLODEOHWUDLQLQJGDWD
DGLVWDQFH IURPWKDWYHFWRUWRHDFKWUDLQLQJFOXVWHU LVFDOFXODWHG)RUDQ\GDWDZKLFKLV
www.intechopen.com
(#
IDU DZD\ IURP WKH WUDLQLQJ VHW LH LV ODUJH WKH YDOXH RI ZLOO EH PLQLPL]HG $V WKH
ZLOOKDYHPLQLPDOUHVLGXDOHIIHFWDQG
ZLOOGRPLQDWH7KLVLVEHFDXVH
UHVXOW
IRUQHZLQVWDQFHV
KDVPRUHVWDEOHJHQHUDOL]DWLRQWKDQ
2JCUG'XCNWCVKQP
7R HYDOXDWH WKH RYHUDOO SHUIRUPDQFH RI WKH IUDPHZRUN WKH &RVWVHQVLWLYH (YDOXDWLRQ
PRGXOH FRPSXWHV VHYHUDO SHUIRUPDQFH PHWULFV DQG DOVR WDNHV LQWR FRQVLGHUDWLRQ GLIIHUHQW
FRVWVFHQDULRV
2GTHQTOCPEG'XCNWCVKQP
2GTHQTOCPEG/GCUWTGU
7R PHDVXUH WKH SHUIRUPDQFH RI GLIIHUHQW OHDUQLQJ DOJRULWKPV WKH IROORZLQJ PHDVXUHV DUH
XVHG
)URP WKH DERYH HTXDWLRQV 6SDP 5HFDOO 65 LV LQ IDFW WKH SHUFHQWDJH RI VSDP PHVVDJHV
WKDW DUH FRUUHFWO\ FODVVLILHG ZKLOH 6SDP 3UHFLVLRQ 63 FRPSDUHV
WRWKHWRWDOQXPEHURIPHVVDJHVFODVVLILHG
WKHQXPEHURIFRUUHFWVSDPFODVVLILFDWLRQV
FRUUHFWO\ DQG LQFRUUHFWO\ DV VSDP $V WKH 0LVV 5DWH 05 LQFUHDVHV WKH
QXPEHURIPLVFODVVLILFDWLRQVRIOHJLWLPDWHHPDLOVLQFUHDVHVZKLOHWKH)DOVH$ODUP5DWH)$5
LQFUHDVHVWKHQXPEHURIPLVFODVVLILFDWLRQVRIVSDPHPDLOVSDVVLQJIURPWKHILOWHULQFUHDVHV
7KHUHIRUH ERWK RI )$5 DQG 05 VKRXOG EH DV VPDOO DV SRVVLEOH IRU D ILOWHU WR EH HIIHFWLYH
VKRXOGEHIRUDSHUIHFWILOWHU
%QUV5GPUKVKXG#PCN[UKU
D &RVW6FHQDULRV
'HSHQGLQJRQZKDWDFWLRQLVWDNHQE\DVSDPILOWHULQUHVSRQVHWRDGHWHFWHGVSDPPHVVDJH
WKHUH DUH WKUHH PDMRU PLVFODVVLILFDWLRQ FRVW VFHQDULRV 7KH QRFRVW FDVH LV ZKHQ WKH ILOWHU
PHUHO\ IODJV D GHWHFWHG VSDP PHVVDJH 7KLV QRWLILFDWLRQ RI VSDP GRHV QRW ULVN ORVLQJ DQ\
OHJLWLPDWHPDLOGXHWRPLVFODVVLILFDWLRQHUURUQRPLVFODVVLILFDWLRQFRVWEXWLWVWLOOWDNHVWLPH
IRUWKHKXPDQXVHUVWRFKHFNDQGGHOHWHWKHVSDPPHVVDJHVPDQXDOO\7RPLQLPL]HWKHXVHU
HIIRUWV RQ HOLPLQDWLQJ VSDP WKH ILOWHU FDQ DXWRPDWLFDOO\ GHWHFW DQG UHPRYH WKH VXVSLFLRXV
PHVVDJHV+RZHYHUWKHWRWDOFRVWRIPLVFODVVLILFDWLRQLQWKLVFDVHFDQEHH[WUHPHO\KLJKGXH
WRWKHVHULRXVQHVVRIIDOVHO\GLVFDUGLQJOHJLWLPDWHPDLOV7KLVUHIHUVWRWKHKLJKFRVWVFHQDULR
%HVLGH WKH DERYH DSSURDFKHV WKH ILOWHU PD\ QRW HLWKHU IODJ RU FRPSOHWHO\ HOLPLQDWH WKH
GHWHFWHGVSDPPHVVDJHV,QVWHDGLWPLJKWUHVHQGWKHPHVVDJHWRWKHVHQGHU7KLVDSSURDFK
UHIHUUHGWRDVPRGHUDWHFRVWFRPEDWVVSDPPLQJE\LQFUHDVLQJLWVFRVWYLD+XPDQ,QWHUDFWLYH
3URRIV+,3/)&UDQRU/D0DFFKLD7KDWLVWKHVHQGHULVUHTXLUHGWRJLYHDSURRI
RIKXPDQLW\WKDWPDWFKHVDSX]]OHEHIRUHKLVPHVVDJHLVGHOLYHUHG7KHSX]]OHVFRXOGEHIRU
www.intechopen.com
(
H[DPSOH LPDJHV FRQWDLQLQJ VRPH WH[W WKDW LV GLIILFXOW WR DXWRPDWLFDOO\ DQDO\]H E\ SDWWHUQ
UHFRJQLWLRQVRIWZDUH$OWHUQDWLYHO\IRUDQWLVSDPSURJUDPVVLPSOHTXHVWLRQVHJ´ZKDWLV
RQHSOXVRQHµFDQEHXVHGLQVWHDGRIJUDSKLFDOSX]]OHV
7KH FRQFHSW RI +,3 KDV EHHQ LPSOHPHQWHG LQ PDQ\ VHFXULW\ UHODWHG DSSOLFDWLRQV )RU
H[DPSOH FHUWDLQ ZHEEDVHG HPDLO V\VWHPV XVH +,3 WR YHULI\ WKDW SDVVZRUG FUDFNLQJ
VRIWZDUHLVQRWV\VWHPDWLFDOO\EUXWHIRUFLQJWRJXHVVDFRUUHFWSDVVZRUGIRUHPDLODFFRXQWV
:KHQ D XVHU W\SHV KLV SDVVZRUG ZURQJ WKUHH WLPHV D GLVWRUWHG LPDJH LV SUHVHQWHG WKDW
FRQWDLQVDZRUGRUQXPEHUVDQGWKHXVHUPXVWYHULI\EHIRUHEHLQJDOORZHGWRFRQWLQXH$
KXPDQ FDQ HDVLO\ FRQYHUW WKH LPDJH WR WH[W EXW WKH VDPH WDVN LV H[WUHPHO\ GLIILFXOW IRU D
FRPSXWHU 6RPH HPDLO FOLHQW SURJUDPV KDYH DQWLVSDP ILOWHULQJ KHXULVWLFV XVLQJ +,3
LPSOHPHQWHG:KHQVXFKSURJUDPVUHFHLYHDQHPDLOWKDWLVQRWLQWKHZKLWHOLVWRIWKHXVHU
WKH\VHQGWKHVHQGHUDSDVVZRUG$KXPDQVHQGHUFDQWKHQUHVHQGWKHHPDLOFRQWDLQLQJWKH
UHFHLYHG SDVVZRUG 7KLV V\VWHP FDQ HIIHFWLYHO\ GHIHDW VSDPPHUV EHFDXVH VSDP LV EXON
PHDQLQJ WKDW WKH VSDPPHUV GR QRW ERWKHU WR FKHFN UHSOLHV PDQXDOO\ RU FRPPRQO\ XVH D
IRUJHGVRXUFHHPDLODGGUHVV7KHFRVWRIFUHDWLQJDQGYHULI\LQJWKHSURRIVLVVPDOOEXWWKH\
FDQ EH FRPSXWDWLRQDOO\ LPSRVVLEOH IRU DXWRPDWHG PDVVPDLOLQJ WRROV WR DQDO\]H 7KRXJK
VSDPPHUV FDQ VWLOO XVH KXPDQ ODERU WR PDQXDOO\ UHDG DQG SURYLGH WKH SURRIV DQG ILQDOO\
KDYH WKHLU VSDP PHVVDJH VHQW +,3 DFWXDOO\ UHVWULFWV WKH QXPEHU RI XQVROLFLWHG PHVVDJHV
WKDW WKH VSDPPHU FDQ VHQG IRU D FHUWDLQ SHULRG RI WLPH GXH WR WKH LQDELOLW\ WR XVH FKHDS
DXWRPDWHG WRROV &DUUHUDV 0DUTXH] 7KLV EDUULHU IRU VSDPPHUV HIIHFWLYHO\
LQWURGXFHVDGGLWLRQDOFRVWWRVHQGLQJVSDPPHVVDJHV
,QWKLVFKDSWHUVSDPUHFRJQLWLRQH[SHULPHQWVDUHFRQGXFWHGLQDFRVWVHQVLWLYHPDQQHU$V
HPSKDVL]HG SUHYLRXVO\ PLVFODVVLI\LQJ D OHJLWLPDWH PHVVDJH DV VSDP LV JHQHUDOO\ PRUH
OHJLWLPDWH
VHYHUH WKDQ PLVWDNHQO\ UHFRJQL]LQJ D VSDP PHVVDJH DV OHJLWLPDWH /HW
FODVVLILHGDVVSDPDQG
VSDPFODVVLILHGDVOHJLWLPDWHGHQRWHWKHWZRW\SHVRIHUURU
UHVSHFWLYHO\:HLQYRNHDGHFLVLRQWKHRUHWLFQRWLRQRIFRVWDQGDVVXPHWKDW
LV WLPHV
$ PDLO LV FODVVLILHG DV VSDP LI WKH IROORZLQJ FULWHULRQ LV PHW
PRUH FRVWO\ WKDQ
$QGURXWVRSRXORVHWDO
,QWKHFDVHRIDQWLVSDPILOWHULQJ
7KHDERYHFULWHULRQEHFRPHV
ZLWK
'HSHQGLQJRQZKLFKFRVWVFHQDULRVDUHFRQVLGHUHGWKHYDOXHRI LVDGMXVWHGDFFRUGLQJO\
x 1RFRVWVFHQDULRHJIODJJLQJVSDPPHVVDJHV
x 0RGHUDWHFRVWVFHQDULRHJVHPLDXWRPDWLFILOWHUZKLFKQRWLILHVVHQGHUVDERXWEORFNHG
PHVVDJHV
x +LJKFRVWVFHQDULRHJDXWRPDWLFDOO\UHPRYLQJEORFNHGPHVVDJHV
E 7RWDO&RVW5DWLR
$FFXUDF\ DQGHUURU UDWHVDVVLJQ HTXDO ZHLJKWV WR WKH WZR HUURU W\SHV /Æ6 6Æ/DQGDUH
GHILQHG
+RZHYHU LQ WKH FRVWVHQVLWLYH FRQWH[WV WKH DFFXUDF\ DQG HUURU UDWHV VKRXOG EH PDGH
VHQVLWLYHWRWKHFRVWGLIIHUHQFHLHHDFKOHJLWLPDWHPHVVDJHLVFRXQWHGIRU WLPHV7KDWLV
www.intechopen.com
($
ZKHQDOHJLWLPDWHPHVVDJHLVPLVFODVVLILHGWKLVFRXQWVDV HUURUVDQGZKHQLWSDVVHVWKH
ILOWHUWKLVFRXQWVDV VXFFHVVHV7KLVOHDGVWRWKHGHILQLWLRQRIZHLJKWHGDFFXUDF\DQGZHLJKWHG
HUURU:$FFDQG:(UU
7KHYDOXHVRISHUIRUPDQFHPHDVXUHVZHLJKWHGRUQRWDUHPLVOHDGLQJO\KLJK7RJHWDWUXH
SLFWXUHRIWKHSHUIRUPDQFHRIDVSDPILOWHULWVSHUIRUPDQFHPHDVXUHVVKRXOGEHFRPSDUHG
DJDLQVW WKRVH RID´EDVHOLQHµDSSURDFK ZKHUH QR ILOWHU LV XVHG 6XFKD EDVHOLQH ILOWHUQHYHU
EORFNVOHJLWLPDWHPHVVDJHVZKLOHVSDPHPDLOVDOZD\VSDVVWKURXJKWKHILOWHU7KHZHLJKWHG
DFFXUDF\DQGHUURUUDWHVIRUEDVHOLQHDUH
7RWDOFRVWUDWLR7&5LVDQRWKHUPHDVXUHZKLFKHYDOXDWHVSHUIRUPDQFHRIVSDPILOWHUWRWKDW
RIDEDVHOLQH
*UHDWHU7&5YDOXHVLQGLFDWHEHWWHUSHUIRUPDQFH)RU7&5WKHEDVHOLQHLVEHWWHU,IFRVWLV
SURSRUWLRQDOWRZDVWHGWLPHD7&5LVLQWXLWLYHO\HTXLYDOHQWWRPHDVXULQJKRZPXFKWLPHLV
ZDVWHGWRPDQXDOO\GHOHWHDOOVSDPPHVVDJHVZKHQWKHILOWHULVXVHG FRPSDUHGWRWKH
WLPH ZDVWHG WR PDQXDOO\ GHOHWH DQ\ VSDP PHVVDJHV WKDW SDVVHG WKH ILOWHU SOXV WKH
WLPHQHHGHGWRUHFRYHUIURPPLVWDNHQO\EORFNHGOHJLWLPDWHPHVVDJHV
'ZRGTKOGPV4GUWNVU
'ZRGTKOGPV&GUKIP
7KHSURSRVHGVSDPUHFRJQLWLRQIUDPHZRUNLVWHVWHGRQWKH/LQJ6SDPFRUSXVWRFRPSDUH
ZLWKRWKHUH[LVWLQJOHDUQLQJPHWKRGVLQFOXGLQJ1DwYH%D\HV1%:HLJKWHG0HPRU\%DVHG
/HDUQLQJ:0%/%RRVWHG7UHHV%76XSSRUW9HFWRU0DFKLQH690DQG1HXUDO1HWZRUN
PRGHOV0XOWLOD\HU3HUFHSWURQ²0/38QOLNHRWKHUWH[WFDWHJRUL]DWLRQWDVNVILOWHULQJVSDP
PHVVDJHV LV FRVW VHQVLWLYH &RKHQ KHQFH HYDOXDWLRQ PHDVXUHV WKDW DFFRXQW IRU
PLVFODVVLILFDWLRQFRVWVDUHXVHG,QSDUWLFXODUZHGHILQHDFRVWIDFWRU ZLWKGLIIHUHQWYDOXHV
FRUUHVSRQGLQJWRWKUHHFRVWVFHQDULRVILUVWQRFRVWFRQVLGHUHG
HJPDUNLQJPHVVDJHV
DVVSDPVHFRQGVHPLDXWRPDWLFILOWHULQJ
HJLVVXLQJDQRWLILFDWLRQDERXWVSDPDQG
HJGLVFDUGLQJWKHVSDPPHVVDJHV
IXOO\DXWRPDWLFILOWHULQJ
7KHUDWHDWZKLFKDOHJLWLPDWHPDLOLVPLVFODVVLILHGDVVSDPLVFDOFXODWHGE\)DOVH$ODUP5DWH
)$5 DQG LW VKRXOG EH ORZ IRU D ILOWHU WR EH XVHIXO 6SDP 5HFDOO 65 PHDVXUHV WKH
HIIHFWLYHQHVV RI WKH ILOWHU LH WKH SHUFHQWDJH RI PHVVDJHV FRUUHFWO\ FODVVLILHG DV VSDP ZKLOH
6SDP3UHFLVLRQ63LQGLFDWHVWKHILOWHU·VVDIHW\LHWKHGHJUHHWRZKLFKWKHEORFNHGPHVVDJHV
DUHWUXO\VSDP%HFDXVH65FDQEHGHULYHGIURP)$5HJ)$5 ²65ZHZLOOXVH6563
DQG 7RWDO &RVW 5DWLR 7&5 IRU HYDOXDWLRQ %HVLGHV FRPSDULQJ KRZ DFFXUDWHO\ WKH ILOWHUV
SHUIRUP WKHLU FRPSXWDWLRQ LV DOVR PHDVXUHG XVLQJ WKH FRPSXWDWLRQ WLPH LQ VHFRQGV
UHTXLUHG IRU HDFK FODVVLILHU 3DUWLFXODUO\ WKH WRWDO FRPSXWDWLRQ WLPH LV D VXPPDWLRQ RI WKH
WLPHWKDWDFODVVLILHUQHHGVWRSHUIRUPFURVVYDOLGDWLRQWHVWLQJRQGDWDDQGWRFDOFXODWHWKH
UHOHYDQWSHUIRUPDQFHPHWULFVHJPLVFODVVLILFDWLRQUDWHDFFXUDF\«
6WUDWLILHG WHQIROG FURVV YDOLGDWLRQ LV HPSOR\HG IRU DOO H[SHULPHQWV 7KDW LV WKH FRUSXV LV
SDUWLWLRQHG LQWR VWUDWLILHG SDUWV DQG HDFK H[SHULPHQW ZDV UHSHDWHG WLPHV HDFK WLPH
www.intechopen.com
(%
UHVHUYLQJDGLIIHUHQWSDUWDVWKHWHVWLQJVHWDQGXVLQJWKHUHPDLQLQJSDUWVDVWKHWUDLQLQJ
VHW3HUIRUPDQFHVFRUHVDUHWKHQDYHUDJHGRYHUWKHLWHUDWLRQV
,Q DGGLWLRQ WR WKH VWXGLHV FRQGXFWHG E\ RWKHU UHVHDUFKHUV RQ WKH VDPH /LQJ6SDP FRUSXV
1%$QGURXWVRSRXORVHWDO:0%/6DNNLVHWDO690+VXHWDO%7
&DUUHUDV0DUTXH]ZHDOVRUHSURGXFHGWKHLUH[SHULPHQWVEDVHGRQWKHDYHUDJH
YDOXHRI7&5RIWKUHHFRVWVFHQDULRVWRFRQILUPDQGGHWHUPLQHWKHSDUDPHWHUV·YDOXHVWKDW
JLYH EHVW SHUIRUPDQFH IRU GLIIHUHQW OHDUQLQJ PHWKRGV 7KH RSWLPDO DWWULEXWH VL]H RI WKHVH
PHWKRGV FDQ EH IRXQG LQ )LJXUH $Q 0/3 ZWK QHXURQV LQ KLGGHQ OD\HU LV GHSOR\HG
XVLQJWKH0DWODE1HXUDO1HWZRUNWRROER[
'ZRGTKOGPV4GUWNV
6%4CPF#VVTKDWVG5GNGEVKQP
DQG
PRVWRIILOWHUVGHPRQVWUDWHDVWDEOHSHUIRUPDQFHZLWK
)URP)LJXUHIRU
7&5 FRQVWDQWO\ JUHDWHU WKDQ 7KHVH ILOWHUV GLIIHU IURP RQH DQRWKHU LQ WHUPV RI WKHLU
VHQVLWLYLW\ RQ DWWULEXWH VHOHFWLRQ DQG WKH QXPEHU RI DWWULEXWHV ZKLFK JLYH PD[LPXP 7&5
2XU/50311LVIRXQGWREHPRGHUDWHO\VHQVLWLYHWRDWWULEXWHVHOHFWLRQDQGLWREWDLQVWKH
KLJKHVW 7&5 IRU
ZLWK DWWULEXWHV VHOHFWHG :KHQ
/50311 DFKLHYHV YHU\
FRPSHWLWLYH7&5FRPSDUHGWR690EXWZLWKOHVVQXPEHURIDWWULEXWHVDWWULEXWHVDQG
KHQFHLQYROYHVOHVVFRPSXWDWLRQRYHUKHDGV
D
www.intechopen.com
(&
E
F
)LJ7&5VFRUHRIVSDPUHFRJQLWLRQPHWKRGV
)RU
DOO FODVVLILHUV KDYH WKHLU 7&5 UHGXFHG VLJQLILFDQWO\ IRU WKH HIIHFW RI YHU\ KLJK
PLVFODVVLILFDWLRQFRVW7KHGLIIHUHQFHEHWZHHQORZDQGKLJKYDOXHVRIPLVFODVVLILFDWLRQFRVW LVWKHLQFUHDVHGSHUIRUPDQFHRIWKHEDVHOLQHILOWHUZKHQ LQFUHDVHV7KDWLVZLWKRXWDILOWHU
LQ XVH EDVHOLQH DOO OHJLWLPDWH PDLOV DUH UHWDLQHG SUHYHQWLQJ WKH EDVHOLQH IURP
PLVFODVVLI\LQJ WKRVH OHJLWLPDWH PDLOV DV VSDP 7KHUHIRU ODUJH EHQHILWV WKH EDVHOLQH DQG
PDNHLWKDUGWREHGHIHDWHGE\RWKHUILOWHUV5HFDOOWKDW7&5LVWKHPHDVXUHRISHUIRUPDQFH
WKDW D ILOWHU LPSURYHV RQ WKH EDVHOLQH FDVH $V D UHVXOW 7&5 JHQHUDOO\ UHGXFHV ZKHQ LQFUHDVHV$QRWKHULPSRUWDQWREVHUYDWLRQLVWKDWWKHSHUIRUPDQFHRIPRVWFODVVLILHUVH[FHSW
IRU %7 DQG /50311 IDOO EHORZ WKH EDVH FDVH 7&5 IRU VRPH QXPEHUV RI VHOHFWHG
DWWULEXWHV7KLVLVGXHWRWKHUHODWLYHLQVHQVLWLYLW\RI%7DQG/50311WRDWWULEXWHVHOHFWLRQ
,Q WKLV FDVH WKH /50311 LV FRQVLGHUHG WR EH WKH EHVW SHUIRUPLQJ ILOWHU ZLWK WKH KLJKHVW
7&5
www.intechopen.com
('
5RCO2TGEKUKQPCPF5RCO4GECNN
,Q WKLV H[SHULPHQW WKH FODVVLILHUV DUH UXQ LWHUDWLYHO\ E\ D WHQIROG FURVVYDOLGDWLRQ SURFHVV
7KH63DQV65UDWHVDUHUHFRUGHGLQ7DEOH:HREVHUYHWKDWIRUWKHQRFRVWVFHQDULR
RXUPHWKRG/50311LVIRXQGWRKDYHEHVW63ZKLOHLWV65LVYHU\VLPLODUWRWKH
KLJKHVW 65 RI 1% )RU
/50311 REWDLQV WKH KLJKHVW 65 DQG VHFRQG
KLJKHVW63DIWHU%7DOJRULWKP)LQDOO\LQWKHFDVHRIH[WUHPHO\KLJKPLVFODVVLILFDWLRQ
/50311 VLJQLILFDQWO\ RXWSHUIRUPV RWKHU PHWKRGV ZLWK DOO HYDOXDWLRQ
FRVW PHWULFVDUHRIKLJKHVWYDOXHV
0HWKRG
O O O 65 63
65
63
65
63
1%
:0%/
690
%7
0/3
/50311
7DEOH3UHFLVLRQ5HFDOOHYDOXDWLRQRQ/LQJ6SDPGDWD
%QORWVCVKQPCN'HHKEKGPE[
$SDUWIURPFRPSDULQJSUHFLVLRQUHFDOODQG7&5VFRUHVEHWZHHQFODVVLILHUVZHDOVRPHDVXUH
WKHLU FRPSXWDWLRQDO HIILFLHQF\ 7DEOH VKRZV WKDW :0%/ KDG WKH PLQLPXP FRPSXWDWLRQ
WLPH PLQV IROORZHG E\ 1% /50311 690 0/3 %7 UHVSHFWLYHO\ /50311 FDQ
DFKLHYHFRPSDUDWLYHVSDPSUHFLVLRQDQGUHFDOOZLWKDVKRUWHUFRPSXWDWLRQWLPHPLQV
FRPSDUHG ZLWK %7 PLQV DQG 690 PLQV 0RUHRYHU FRQVLGHULQJ 7&5 VFRUHV WKH
PRGHOVWKDWUHTXLUHOHVVWLPH:0%/1%WKDQ/50311GRQRWSHUIRUPDVDFFXUDWHO\DV
/50311
0HWKRG
&RPSXWDWLRQ7LPHPLQV O
O O 7&5
7&5
7&5
1%
:0%/
690
%7
0/3
/50311 7DEOH&RPSXWDWLRQ7LPH0HPRU\VL]HHYDOXDWLRQRQ/LQJ6SDPGDWD
,QVXPPDU\WKHPRVWLPSRUWDQWILQGLQJLQRXUH[SHULPHQWLVWKDWWKHSURSRVHG/50311
PRGHO FDQ DFKLHYH YHU\ DFFXUDWH FODVVLILFDWLRQ KLJK 7&5 63 65 FRPSDUHG WR RWKHU
FRQYHQWLRQDO OHDUQLQJ PHWKRGV 6XFK VXSHULRU SHUIRUPDQFH RI /50311 ZDV REVHUYHG
PRVWFOHDUO\IRU
WKRXJKLWDOZD\VREWDLQVWKHKLJKHVW7&5DQGYHU\FRPSHWLWLYH63
65UDWHVIRURWKHUFDVHVRI 2XUDOJRULWKPDOVRUHTXLUHVUHODWLYHO\VPDOOFRPSXWDWLRQWLPH
WRREWDLQFRPSDUDEOHRUHYHQKLJKHUSUHGLFWLYHDFFXUDF\WRRWKHUPHWKRGV
www.intechopen.com
)
%QPENWUKQPUCPF(WVWTG9QTM
,Q WKLV FKDSWHU ZH SURSRVHG D QRYHO DQWLVSDP ILOWHULQJ IUDPHZRUN LQ ZKLFK DSSURSULDWH
GLPHQVLRQ UHGXFWLRQ VFKHPHV DQG SRZHUIXO FODVVLILFDWLRQ PRGHOV DUH HPSOR\HG
3DUWLFXODUO\ 3ULQFLSDO &RPSRQHQW $QDO\VLV WUDQVIRUPV GDWD WR D ORZHU GLPHQVLRQDOVSDFH
$WWKHFODVVLILFDWLRQVWDJHZHFRPELQHDVLPSOHOLQHDUUHJUHVVLRQPRGHOZLWKDOLJKWZHLJKW
QRQOLQHDUQHXUDOQHWZRUNLQDQDGMXVWDEOHZD\7KLVOHDUQLQJPHWKRGUHIHUUHGWRDV/LQHDU
5HJUHVVLRQ 0RGLILHG 3UREDELOLVWLF 1HXUDO 1HWZRUN /50311 FDQ WDNH DGYDQWDJH RI WKH
YLUWXHVRIERWK7KDWLVWKHOLQHDUPRGHOSURYLGHVUHOLDEOHJHQHUDOL]DWLRQFDSDELOLW\ZKLOHWKH
QRQOLQHDU FDQ FRPSHQVDWH IRU KLJKHU RUGHU FRPSOH[LWLHV RI WKH GDWD $ FRVWVHQVLWLYH
HYDOXDWLRQ XVLQJ D SXEOLFO\ DYDLODEOH FRUSXV /LQJ6SDP KDV VKRZQ WKDW RXU /50311
FODVVLILHU FRPSDUHV IDYRUDEO\ WR RWKHU VWDWHRIWKHDUW PHWKRGV ZLWK VXSHULRU DFFXUDF\
DIIRUGDEOH FRPSXWDWLRQ DQG KLJK V\VWHP UREXVWQHVV (VSHFLDOO\ IRU H[WUHPHO\ KLJK
PLVFODVVLILFDWLRQFRVWZKLOHRWKHUPHWKRGV·SHUIRUPDQFHGHWHULRUDWHVDV LQFUHDVHVWKH/5
0311GHPRQVWUDWHVDQDEVROXWHO\VXSHULRURXWFRPHEXWUHWDLQVORZFRPSXWDWLRQFRVW/5
0311 DOVR KDV VLJQLILFDQW ORZ FRPSXWDWLRQDO UHTXLUHPHQW LH LWV WUDLQLQJ WLPH LV VKRUWHU
WKDQRWKHUDOJRULWKPVZLWKVLPLODUDFFXUDF\DQGFRVW7KRXJKRXUSURSRVHGPRGHODFKLHYHV
JRRG UHVXOWV LQ WKH FRQGXFWHG H[SHULPHQWV LW LV QRW QHFHVVDULO\ WKH EHVW VROXWLRQ IRU DOO
SUREOHPV+RZHYHUFRPSDUDWLYHO\KLJKSUHGLFWLYHDFFXUDF\DORQJZLWKORZFRPSXWDWLRQDO
FRPSOH[LW\ GLVWLQJXLVK LW IURP RWKHU VWDWHRIWKHDUW OHDUQLQJ DOJRULWKPV DQG SDUWLFXODUO\
VXLWDEOHIRUFRVWVHQVLWLYHVSDPGHWHFWLRQDSSOLFDWLRQV
4GHGTGPEGU
$QGURXWVRSRXORV , .RXWVLDV - &KDQGULQRV . 9 3DOLRXUDV * 6S\URSRXORV & '
$Q (YDOXDWLRQ RI 1DLYH %D\HVLDQ $QWL6SDP )LOWHULQJ 3DSHU SUHVHQWHG DW
WKH3URFRIWKH(&0/
%D\OHU*3HQHWUDWLQJ%D\HVLDQ6SDP)LOWHUV9'09HUODJ'U0XHOOHUH.
&DUUHUDV ; 0DUTXH] / %RRVWLQJ 7UHHV IRU $QWL6SDP (PDLO )LOWHULQJ 3DSHU
SUHVHQWHGDWWKH5$1/37]LJRY&KDUN%XOJDULD
&RKHQ:/HDUQLQJUXOHVWKDWFODVVLI\HPDLO$$$,6XPS2Q0DFKLQH/HDUQLQJLQ
,QI$FFHVV
&UDQRU/)/D0DFFKLD%$6SDP3DSHUSUHVHQWHGDWWKH&RPPXQLFDWLRQVRI
$&0
&UDQRU / ) /D0DFFKLD %$ 6SDP 3DSHU SUHVHQWHG DW WKH &RPPXQLFDWLRQV RI
$&0
'UXFNHU + :X ' 9DSQLN 9 1 6XSSRUW 9HFWRU 0DFKLQHV IRU 6SDP
&DWHJRUL]DWLRQ,(((7UDQVDFWLRQV2Q1HXUDO1HWZRUNV
+D\HV0+6WDWLVWLFDO'LJLWDO6LJQDO3URFHVVLQJDQG0RGHOLQJ-RKQ:LOH\6RQV
,QF
+VX&:&KDQJ&&/LQ-&/,%690DOLEUDU\IRUVXSSRUWYHFWRUPDFKLQHV
IURPKWWSZZFVLHQWXHGXWZaFMOLQOLEVY
-ROOLIIH,73ULQFLSOH&RPSRQHQW$QDO\VLVHG1HZ<RUN86$6SULQJHU
5XPHOKDUW'(0F&OHOODQG-/3DUDOOHO'LVWULEXWHG3URFHVVLQJ([SORUDWLRQVLQ
WKH0LFURVWUXFWXUHRI&RJQLWLRQ9RO7KH0,73UHVV
www.intechopen.com
6DKDPL 0 6 'XPDLV ' +HFNHUPDQ DQG ( +RUYLW] $ %D\HVLDQ $SSURDFK WR
)LOWHULQJ -XQN (0DLO 3DSHU SUHVHQWHG DW WKH /HDUQLQJ IRU 7H[W &DWHJRUL]DWLRQ ²
$$$,7HFKQLFDO5HSRUW:6
6DNNLV * $QGURXWVRSRXORV , 3DOLRXUDV * .DUNDOHWVLV 9 6S\URSRXORV & ' 6WDPDWRSRXORV 3 $ 0HPRU\%DVHG $SSURDFK WR $QWL6SDP )LOWHULQJ IRU
0DLOLQJ/LVWV3DSHUSUHVHQWHGDWWKH,QIRUPDWLRQ5HWULHYDO
6FKDSLUH 5 ( 6LQJHU < %RRV7H[WHU D %RRVWLQJ%DVHG 6\VWHP IRU 7H[W
&DWHJRUL]DWLRQ0DFKLQH/HDUQLQJ²
6FKU\HQ*$QWL6SDP0HDVXUHV$QDO\VLVDQG'HVLJQ6SULQJHU
6XUHSD\UROO 0RUH WKDQ 3HUFHQW RI 6PDOO %XVLQHVV 2ZQHUV &RQVLGHU (PDLO
(VVHQWLDOWR6XFFHVV6XUH3D\UROO,QVLJKWV6XUYH\
6ZDUW] 1 6SDP FRVWV EXVLQHVVHV ELOOLRQ DQQXDOO\ ,QIRUPDWLRQ 0DQDJHPHQW
-RXUQDO
:ROIH36FRWW&(UZLQ0$QWL6SDP7RRO.LW0F*UDZ+LOO2VERUQH0HGLD
=DNQLFK $ ,QWURGXFWLRQ WR WKH PRGLILHG SUREDELOLVWLF QHXUDO QHWZRUN IRU JHQHUDO
VLJQDOSURFHVVLQJDSSOLFDWLRQV,(((7UDQVDFWLRQVRQ6LJQDO3URFHVVLQJ
=DNQLFK $ 1HXUDO 1HWZRUNV IRU ,QWHOOLJHQW 6LJQDO 3URFHVVLQJ 6\GQH\ :RUOG
6FLHQWLILF3XEOLVKLQJ
www.intechopen.com
(
www.intechopen.com
Pattern Recognition
Edited by Peng-Yeng Yin
ISBN 978-953-307-014-8
Hard cover, 568 pages
Publisher InTech
Published online 01, October, 2009
Published in print edition October, 2009
For more than 40 years, pattern recognition approaches are continuingly improving and have been used in an
increasing number of areas with great success. This book discloses recent advances and new ideas in
approaches and applications for pattern recognition. The 30 chapters selected in this book cover the major
topics in pattern recognition. These chapters propose state-of-the-art approaches and cutting-edge research
results. I could not thank enough to the contributions of the authors. This book would not have been possible
without their support.
How to reference
In order to correctly reference this scholarly work, feel free to copy and paste the following:
Tich Phuoc Tran, Min Li, Dat Tran and Dam Duong Ton (2009). Spam Recognition using Linear Regression
and Radial Basis Function Neural Network, Pattern Recognition, Peng-Yeng Yin (Ed.), ISBN: 978-953-307-
014-8, InTech, Available from: http://www.intechopen.com/books/pattern-recognition/spam-recognition-usinglinear-regression-and-radial-basis-function-neural-network
InTech Europe
University Campus STeP Ri
Slavka Krautzeka 83/A
51000 Rijeka, Croatia
Phone: +385 (51) 770 447
Fax: +385 (51) 686 166
www.intechopen.com
InTech China
Unit 405, Office Block, Hotel Equatorial Shanghai
No.65, Yan An Road (West), Shanghai, 200040, China
Phone: +86-21-62489820
Fax: +86-21-62489821