Pakanan opo neh kui?, haha, asline nek proyek ng lab sik wifi handoff, terus paling kie ssuk openflow SDN lha wong jenenge ae lab advanced network koq haha, tapi Pak prof'e kui bidange ng "ubiquitous computing".
Nek semester siji iki aku kuliah kon njipuk 3 matkul : Distributed System, Pattern Recognition, Special Topics in Computer Engineering.
Nah nek sik DS kro Special Topics in Computer Engineering kon gawe project, nah project'e tak gawe siji ae, podo cuman mengko penekananne bedo.
image source => http://www.i95dev.com/is-real-time-processing-better-than-batch-processing/
Sik kelas DS kan distributed kie, lagi mongso hadoop tapi kan hadoop mung kerjone ng batch processing, dadi data static, emang kie keren nek nggo analisis data sik gedhe di sandingke kro mapreduce, tapi hadoop iki kan ra nggo real time, nah ono solusi liyane, contone ono S4 kui udu galaxy S4 lho.. wkw, S4 kui proyek sko apache juga link S4 . Nah tapi ono neh liyane sik keren tur opensource sik digawe kro mas natan sko twitter, jenenge storm situs asline ng kene => http://storm-project.net/ .
kui iso nggo real time. Aku yo bar moco berita versi terbarune Hadoop YARN kui yo meh implementasikne storm sih, dadi mengko hadoop iso nggo analisis data real time.
Nah sik matkul special topic kan mbahas e cloud computing kro transcoding, makane pinginne tak kawinke, video transcodingnge yo nggowo opensource lah nggowo ffmpeg, terus colud e nggowo openstack wah keren lah, ketoe sik simple, bar njajal di implementasikke wooooo.. sangar, hehe, ngono kae lah wkwkw..
Design ne kurang lebih kyo iki :
Ono gambar design'e tapi ra tak publish, nek ono sik tertarik kro project iki iso contact via email op liyane :)
Yo dadi akhir'e ono presentasi project akhir, tapi dadine rusak wkwk..
intine rung berhasil ono sebabe koq ra berhasil, soale tak coba twitter storm kui nggo API twitter njajal njipuk data real time terus njajal paling simple wordcount twitter using twitter storm kui berhasil, tapi nek pas di jajal nggo video transcoding kui gagal tur mesti error, ngopo coba? intine ngene :
Real time distributed video transcoding using storm failed:
Nek semester siji iki aku kuliah kon njipuk 3 matkul : Distributed System, Pattern Recognition, Special Topics in Computer Engineering.
Nah nek sik DS kro Special Topics in Computer Engineering kon gawe project, nah project'e tak gawe siji ae, podo cuman mengko penekananne bedo.
image source => http://www.i95dev.com/is-real-time-processing-better-than-batch-processing/
Sik kelas DS kan distributed kie, lagi mongso hadoop tapi kan hadoop mung kerjone ng batch processing, dadi data static, emang kie keren nek nggo analisis data sik gedhe di sandingke kro mapreduce, tapi hadoop iki kan ra nggo real time, nah ono solusi liyane, contone ono S4 kui udu galaxy S4 lho.. wkw, S4 kui proyek sko apache juga link S4 . Nah tapi ono neh liyane sik keren tur opensource sik digawe kro mas natan sko twitter, jenenge storm situs asline ng kene => http://storm-project.net/ .
kui iso nggo real time. Aku yo bar moco berita versi terbarune Hadoop YARN kui yo meh implementasikne storm sih, dadi mengko hadoop iso nggo analisis data real time.
Nah sik matkul special topic kan mbahas e cloud computing kro transcoding, makane pinginne tak kawinke, video transcodingnge yo nggowo opensource lah nggowo ffmpeg, terus colud e nggowo openstack wah keren lah, ketoe sik simple, bar njajal di implementasikke wooooo.. sangar, hehe, ngono kae lah wkwkw..
Design ne kurang lebih kyo iki :
Ono gambar design'e tapi ra tak publish, nek ono sik tertarik kro project iki iso contact via email op liyane :)
Yo dadi akhir'e ono presentasi project akhir, tapi dadine rusak wkwk..
intine rung berhasil ono sebabe koq ra berhasil, soale tak coba twitter storm kui nggo API twitter njajal njipuk data real time terus njajal paling simple wordcount twitter using twitter storm kui berhasil, tapi nek pas di jajal nggo video transcoding kui gagal tur mesti error, ngopo coba? intine ngene :
Real time distributed video transcoding using storm failed:
- Dadi aku kro kancaq nggolek library ffmpeg sik nggo java kui jenenge xuggler , nah project kui malah wis discontinue, wah jan repot tenan dadi wis kadarluarso lah libraryne, terus golek library ffmpeg sik python yo nasib be podo.. asem, mumet kie.
- Mergo kepekso akhire mutusne yowislah nganggo subprocess ae, mergone library wis ra iso di enggo akhire nggo subprocess, njajal coding manggil ffmpeg ng codingane, wah jebul2 storm rung support subprocess ngunu kui, intine ngunu kui lah hheee..
- tapi awak dewe wis njajal gawe aplikasi simple sik ra jelas, sik iso nranscode video secara distributed lah, dadi ono hasil le, ra ketang rodo remuk :)
Nah intine asline nek meh di oprek apik kie, sumpeh, hehe, yo nek di vs ke hadoop vs storm ngunu yo ra cocok lah, soale 2 project kui di gawe tujuane rodo bedo nek hadoop kan nggo batch processing tur data gedhe, nek storm awalle kan project sko twitter dadi nggo analisis tweet, luwih cerak ng CEP lah Complex Event Processing sih jarene :).
0 comments:
Post a Comment