Joy Chrissetyo Prajogo 王智豪
East District, Hsinchu City, 300093, Republic of China (Taiwan)
+886972948350 | joy.chr.pr@gmail.com
Formal Education
National Yang Ming Chiao Tung University (NYCU), Hsinchu, Republic of China (Taiwan)
2024 - 2026 (Expected)Master of Science (M.S.) in Electrical Engineering and Computer Science (EECS)
- CGPA: 4.04 / 4.30
- Advisor: Professor Hsien-I Lin 林顯易 教授
- Laboratory: Human-Centered Robotic and Automation Laboratory
- Research Interest: Vision-Language Model, Image Processing, Computer Vision, Generative AI
- Research Topic: Detection Vision-Language Model for Robotic Assembly
- Relevant Coursework: Data Mining, Machine Learning for Signal Processing, Pattern Recognition, Deep Learning, Digital Image Processing, Mobile Robots, Applications of Language Processing in Practice, Computer Vision, Practice in Entrepreneurship
Gadjah Mada University (UGM), Yogyakarta, Indonesia
Aug 2018 - Aug 2022Bachelor of Engineering (B.Eng.) in Information Engineering (IT)
- Final CGPA: 3.65 / 4.00 (Cum Laude)
- Thesis Advisor: Prof. Ir. Hanung Adi Nugroho, S.T., M.Eng., Ph.D., IPM, SMIEEE, MACM
- Thesis: Online Lectures Monitoring Software Component Development and Engineering
- Relevant Coursework: Algorithms and Data Structures, Artificial Intelligence, Image Processing and Computer Vision, Natural Language Processing, Big Data and Analytics, Database Engineering, Software Engineering
Professional Experience
National Yang Ming Chiao Tung University (NYCU), Hsinchu, Republic of China (Taiwan)
Master (M.S.) Student Researcher, Full Time
February 2024 - Present- Joining Human-Centered Robotics and Automation Laboratory (Hucenrotia Lab), NYCU in the Generative Artificial Intelligence (GAI) team.
- Created and arranged the system architecture for utilizing LINE Bot with ChatGPT in Azure cloud environments.
- Managing the laboratory AI and computing server PC as the main administrator.
- Researching and creating an integrated vision system utilizing Vision-Language Model (VLM) and a function for object detection also object coordinate location.
- Skills: Python, Image Processing, Computer Vision, Deep Learning, Machine Learning, Generative Artificial Intelligence, Natural Language Processing, System Architecture and Integration, Project Management
National Yang Ming Chiao Tung University (NYCU), Hsinchu, Republic of China (Taiwan)
Research Assistant, Internship
September 2023 - December 2023- Taiwan Experience Education Program (TEEP) in Human-Centered Robotics and Automation (Hucenrotia) Laboratory, NYCU. Joining the Collaborative Autonomous Mobile Robots research group.
- Created a program flow for robotic arm in the autonomous mobile robot using TMFlow for Awarding Ceremony.
- Research about implementing Inverse Kinematics for Isaac Sim simulation.
- Research and ideation about robotic arm end-effector error calculations and end-effector manipulability.
- Skills: Python, Natural Language Processing, TMFlow TM Robot, Isaac Sim NVIDIA, Robotics
PT Optimal Partner Nusantara (OPPNA), Jakarta, Indonesia
Data Engineer, Internship
December 2022 - June 2023- Helped Senior Data Engineer with daily maintenance tasks, urgent tasks and issues, tech backlog, and system monitoring.
- Created Automate Address Domicile Prediction and Correction, an in-house program and algorithm to predict and correct domicile name aliases, using pattern matching technique and dictionary, solving and correcting valid but incorrect domicile name aliases. The accuracy results for correcting city domicile name aliases reached 79,1% and for correcting district name aliases reached 97,6%.
- Created Personal Identifiable Information (PII) Scanner, an in-house algorithm, model, and program to scan, profile, and tag PII from database tables. The created algorithm and model accuracy outperforms Google Sensitive Data Protection [formerly Google Data Loss Prevention] for Indonesian PII data. The accuracy result of Google Data Loss Prevention at the time was around 35-50% meanwhile the created algorithm and model reached 75-91%.
- Research and defining bad data and garbage data within data sources. The definition leads to ideation how to treat those and created a Looker mock-up design of usable implementation in form of table report for data exploration.
- Skills: Python, SQL, Machine Learning, Natural Language Processing, Data Analysis, JupyterLab, BigQuery, Docker, Looker Studio, Airflow, Streamlit
Relevant Projects
Annotator-Aware Two-Stage Pipeline Tweets Sexism Detection - Masters Applications of Language Processing in Practice Course
- An empirical study of three systems implementations: fine-tuned Transformer-based with early and late fusion, zero-shot Auto-Regressive (AR) LLM based, and zero-shot Diffusion LLM based.
- All systems follow the same two-stage pipeline then leverages bilingual fusion by combining original and cross-translated tweet and integrates annotator demographic.
- Utilized Python, PyTorch.
- Paper published. Joy Chrissetyo Prajogo, Lung-Hao Lee, and Hsien-I Lin (2025). NYCU-NLP at EXIST 2025: An Empirical Study of Annotator-Aware Two-Stage Pipeline for Sexism Detection in Tweets. In Proceedings of the Working Notes of CLEF 2025 - Conference and Labs of the Evaluation Forum, Madrid, Spain, 9-12 September 2025, vol. 4038, pp. 2119-2132.
Dual Dense Upsampling Convolution for Cityscapes Dataset Segmentation - Masters Computer Vision Course
- Implemented Dual Dense Upsampling Convolution (DDUC) for road scene semantic segmentation using the Cityscapes dataset, based on ICCEA 2024 research.
- Integrated DDUC into the SegProp framework for semi-supervised segmentation of aerial videos using the RuralScapes dataset.
- Developed a video inference pipeline to generate segmented video outputs from raw input footage.
- Built a module to quantify the Quality of Green Urban areas from semantic segmentation results.
- Utilized Python, PyTorch, OpenCV, and NumPy for model development and evaluation.
Contrails Segmentation - Masters Image Processing Course
- Conducted contrail segmentation on satellite imagery using deep learning models to support climate change mitigation in aviation.
- Compared segmentation architectures including UNet, EfficientNetB7+UNet, and CBAM+UNet, using a 450GB dataset from a Kaggle competition.
- Standardized training with Adam optimizer, 11 epochs, and consistent hyperparameters across all experiments.
- Evaluated model performance using DICE Score, testing both BCE and BCE + Dice loss functions.
- Achieved highest performance with EfficientNetB7 + UNet using BCE loss, improving segmentation accuracy over the baseline.
Robotic Generative AI 3-Cup and Ball Game - Human-Centered Robotic and Automation Laboratory
- Developing the vision system of the Robotic Generative AI 3-Cup and Ball Game project.
- The vision system will utilize YOLOv7 to detect the cups and ball then use SORT algorithm to track the ball and the cups. This detection and tracking will be combined with custom algorithm to track the ball inside the cup.
- The project is showcased in the Intelligent Asia 2024 in Nangang, Taipei, Taiwan on August 21-24, 2024, inside one of the areas within the National Science and Technology Council booth.
- Paper published. N. Khoirurizka, J. C. Prajogo, S. Perkins, C. -H. Kuo and H. -I. Lin, A Case of Cups and a Ball: Utilizing Generative Artificial Intelligence for Human-robotic Collaboration in Task Execution, 2024 International Automatic Control Conference (CACS), Taoyuan, Taiwan, 2024, pp. 1-6, doi: 10.1109/CACS63404.2024.10773301.
Simple Video Stabilizer - Bachelors Image Processing and Computer Vision Course
- Created a Python program utilizing OpenCV and Numpy.
- The program implemented Corner Detection to get the tracking points and then Optical Flow to track the points with the goal is to calculate the displacement for the shakiness.
- The input is a shaky video, and the output is a stabilized video that shakiness or unstable factor has been removed.
Ultrasound Image Segmentation and Classification - Bachelors Image Processing and Computer Vision Course
- Created a Python script utilizing OpenCV, Numpy, and Tensorflow.
- The program implemented several image processing techniques and U-Net architecture for segmentation the cancer and tumour areas, then DenseNet201 for feature extraction and classification part to get the features of the segmentation and to classify the cancer or tumour whether it is malignant or benign.
- The metrics used in the project are Region Over Curve (ROC), Area Under Curve (AUC), and Accuracy.
- The input is ultrasound medical images with cancer and tumour cases.
Simple Sentiment Analysis - Bachelors Natural Language Processing Course
- Created a Python script utilizing Pandas, Numpy, NLTK, Scikit-Learn.
- The script will implement data selection techniques, data processing with 6 techniques or methods, and then classification.
- The metrics used in the project are Accuracy, Precision, Recall, and F1-score.
- The input is Tripadvisor hotel reviews data. The output is a statistical report and analysis.
Skills and Interests
Technical Skills and Knowledge: Python, C/C++, SQL, Computer Vision, Image Processing, Artificial Intelligence, Machine Learning, Deep Learning, Data Science, Data Analytics, Natural Language Processing, Data Engineering.
Languages: Indonesian (Native proficiency), English (Professional working proficiency-IELTS C1), Chinese (Elementary proficiency-TOCFL A1), German (Elementary proficiency).
Interests: Artificial Intelligence, Machine Learning, and Deep Learning in various areas (e.g. Computer Vision, Image Processing, Generative Models and Algorithms, Signal Processing) and their implementation.
Volunteer Experience
Vice President, NYCU Indonesian Student Association
August 2024 - July 2025- Helping the President of NYCU Indonesian Student Association to arrange events.
- Guiding and helping new and current Indonesian students in NYCU with their campus life.
Student Unit Coordinator, KKM-PPM UGM Unit YO123
July 2021 - August 2021- Leading a student group of 30 members.
- Plan and do 102 programs for village communities in Yogyakarta, Indonesia in 50 days.
- The programs made to empower the local communities have various goal areas, from economic development, environmental, technology, social studies, public health, and others.
NDDC President, Night Login
November 2020 - November 2021- President of Night Login Data Science and Data Analytics Community (NDDC), a division of a student body community for Information Engineering students.
- Creating training curriculum related to Data Science and Data Analytics for the members.
- Give the training to the members.
Joy Chrissetyo Prajogo 王智豪
中華民國(臺灣) 300093 新竹市東區
+886972948350 | joy.chr.pr@gmail.com
正規教育
國立陽明交通大學 (陽明交大),新竹市,中華民國 (台灣)
2024 - 2026 (預計)電機資訊國際碩士學位學程 (EECS) 理學碩士 (M.S.)
- 目前累計平均績點 (CGPA): 4.04 / 4.30
- 指導教授: Professor Hsien-I Lin 林顯易 教授
- 實驗室: 人中心機器人與自動化實驗室
- 研究興趣: 視覺語言模型、影像處理、電腦視覺、生成式人工智慧
- 研究主題: 應用於機器人組裝的視覺語言模型
- 相關課程: 資料探勘、機器學習之訊號處理應用、圖形識別、深度學習、影像處理、自走式機器人、語言處理應用實踐、電腦視覺、創業實作
Gadjah Mada University (UGM),日惹,印尼
2018 年 8 月 - 2022 年 8 月資訊工程 (IT) 工程學士 (B.Eng.)
- 最終累積平均績點: 3.65 / 4.00 (Cum Laude)
- 指導教授: Prof. Ir. Hanung Adi Nugroho, S.T., M.Eng., Ph.D., IPM, SMIEEE, MACM
- 學士論文: Online Lectures Monitoring Software Component Development and Engineering
- 相關課程: 演算法與資料結構、人工智慧、影像處理與電腦視覺、自然語言處理、大數據與分析、資料庫工程、軟體工程
工作經驗
國立陽明交通大學 (陽明交大),新竹市,中華民國 (台灣)
碩士(M.S.)生研究員,全職
2024 年 2 月 - 現在- 加入紐約大學以人為人中心機器人與自動化實驗室 (Hucenrotia Lab) 的生成人工智慧 (GAI) 團隊。
- 建立並安排了在 Azure 雲端環境中使用 LINEBot 和 ChatGPT 的系統架構。
- 作為主管理員管理實驗室的AI和計算伺服器PC。
- 研究並創建一個利用視覺語言模型(VLM)和物件偵測和物件座標定位功能的整合視覺系統。
- 技術技能: Python、影像處理、電腦視覺、深度學習、機器學習、生成人工智慧、自然語言處理、系統架構與整合、專案管理
國立陽明交通大學 (陽明交大),新竹市,中華民國 (台灣)
研究助理,實習
2023 年 9 月 - 2023 年 12 月- 國立陽明交通大學以人中心機器人與自動化實驗室(Hucenrotia Lab)的台灣體驗教育計畫(TEEP)。加入協作自主移動機器人研究小組。
- 使用TMFlow為頒獎典禮創建了自主移動機器人中機械手臂的程序流程。
- 關於為 Isaac Sim 模擬實現逆運動學的研究。
- 關於機械手臂末端執行器誤差計算和末端執行器可操作性的研究和構思。
- 技術技能: Python、自然語言處理、TMFlow TM Robot、Isaac Sim NVIDIA、機器人
PT Optimal Partner Nusantara (OPPNA),雅加达,印尼
資料工程師,實習
2022 年 12 月 - 2023 年 6 月- 幫助資深資料工程師完成日常維護任務、緊急任務和問題、技術積壓和系統監控。
- 創建了自動地址住所預測和更正,這是一個內部程序和演算法,用於預測和糾正住所名稱別名,使用模式匹配技術和字典,解決和糾正有效但不正確的住所名稱別名。都市戶籍別名修正準確率達79.1%,區名別名修正準確率達97.6%。
- 建立個人識別資訊 (PII) 掃描程序,這是一種內部演算法、模型和程序,用於從資料庫表中掃描、分析和標記 PII。對於印尼 PII 數據,所創建的演算法和模型的準確性優於 Google 敏感資料保護 [先前 Google 資料遺失的防護]。當時Google Data Loss Prevention的準確率結果約為35-50%,而創建的演算法和模型達到了75-91%。
- 研究和定義資料來源中的不良資料和垃圾資料。這個定義引發瞭如何處理這些問題的想法,並以用於資料探索的表格報告的形式創建了可用實現的 Looker 模型設計。
- 技術技能: Python、SQL、機器學習、自然語言處理、資料分析、JupyterLab、BigQuery、Docker、Looker Studio、Airflow、Streamlit
相關項目
具註釋者意識之雙階段推論流程:推特性別歧視偵測 - 碩士語言處理應用實踐課程
- 進行三種系統實作的實證研究:微調型 Transformer 系統(包含早期與後期融合)、零樣本自回歸大型語言模型(AR LLM)系統,以及零樣本擴散式 LLM 系統。
- 所有系統皆採用相同的雙階段流程,並透過原始與交叉翻譯推文進行雙語融合,融合註釋者人口背景資訊。
- 使用 Python、PyTorch 進行開發與實驗。
- 已發表論文。 Joy Chrissetyo Prajogo, Lung-Hao Lee, and Hsien-I Lin (2025). NYCU-NLP at EXIST 2025: An Empirical Study of Annotator-Aware Two-Stage Pipeline for Sexism Detection in Tweets. In Proceedings of the Working Notes of CLEF 2025 - Conference and Labs of the Evaluation Forum, Madrid, Spain, 9-12 September 2025, vol. 4038, pp. 2119-2132。
Dual Dense Upsampling Convolution for Cityscapes 資料集語意分割 - 碩士電腦視覺課程
- 實作 Dual Dense Upsampling Convolution(DDUC)模型,應用於 Cityscapes 資料集的道路場景語意分割,基於 ICCEA 2024 研究。
- 將 DDUC 整合至 SegProp 架構,用於 RuralScapes 空拍影片的半監督式語意分割任務。
- 開發影片推論流程,將原始輸入影片轉換為語意分割結果影片。
- 建立模組以量化語意分割結果中綠色城市空間的品質。
- 使用 Python、PyTorch、OpenCV 與 NumPy 進行模型開發與評估。
飛航凝結尾(Contrails)語意分割 - 碩士影像處理課程
- 利用深度學習模型對衛星影像進行飛航凝結尾的語意分割,支持航空業減碳與氣候變遷研究。
- 比較 UNet、EfficientNetB7+UNet、CBAM+UNet 等架構,在 Kaggle 提供的 450GB 資料集上進行實驗。
- 所有實驗皆使用 Adam 優化器、11 個訓練週期與統一超參數設定。
- 評估指標為 DICE Score,並測試 BCE 以及 BCE + Dice 混合損失函數。
- 使用 BCE 損失的 EfficientNetB7 + UNet 模型表現最佳,有效提升語意分割準確率
機器人生成式AI三杯球賽 - 人中心機器人與自動化實驗室
- 開發機器人生成人工智慧三杯球賽項目的視覺系統。
- 視覺系統將利用YOLOv7來偵測杯子和球,然後使用SORT演算法來追蹤球和杯子。這種檢測和追蹤將與自訂演算法相結合,以追蹤杯子內的球。
- 該計畫將於 2024 年 8 月 21 日至 24 日在台灣台北南港舉行的「2024 年智慧亞洲」展會上在國家科學技術委員會展位內的一個區域內展示。
- 已發表論文。 N. Khoirurizka, J. C. Prajogo, S. Perkins, C. -H. Kuo and H. -I. Lin, A Case of Cups and a Ball: Utilizing Generative Artificial Intelligence for Human-robotic Collaboration in Task Execution, 2024 International Automatic Control Conference (CACS), Taoyuan, Taiwan, 2024, pp. 1-6, doi: 10.1109/CACS63404.2024.10773301。
簡單的視訊穩定器 - 學士影像處理和電腦視覺課程
- 使用 OpenCV 和 Numpy 創建了一個 Python 程式。
- 程式實作角點偵測來取得追蹤點,然後實作光流來追蹤點,目標是計算抖動的位移。
- 輸入是抖動視頻,輸出是已消除抖動或不穩定因素的穩定視頻。
超音波影像分割和分類 - 學士影像處理和電腦視覺課程
- 利用 OpenCV、Numpy 和 Tensorflow 建立了一個 Python 腳本。
- 該程式實現了多種影像處理技術和 U-Net 架構來分割癌症和腫瘤區域,然後使用 DenseNet201 進行特徵提取和分類部分,以獲得分割的特徵並對癌症或腫瘤進行分類,無論是惡性還是良性。
- 此專案中使用的指標是曲線上區域 (ROC)、曲線下面積 (AUC) 和準確度。
- 輸入是包含癌症和腫瘤病例的超音波醫學影像。
簡單情緒分析 - 學士自然語言處理課程
- 利用 Pandas、Numpy、NLTK、Scikit-Learn 創建了一個 Python 腳本。
- 該腳本將實現資料選擇技術、使用 6 種技術或方法進行資料處理,然後進行分類。
- 此項目中使用的指標是準確度、精確度、召回率和 F1 分數。
- 輸入是 Tripadvisor 飯店點評資料。輸出是統計報告和分析。
技能和興趣
技術技能和知識: Python、C/C++、SQL、電腦視覺、影像處理、人工智慧、機器學習、深度學習、資料科學、資料分析、自然語言處理、資料工程。
語言: 印尼語(母語程度)、英語(專業工作程度-IELTS C1)、中文(初級程度-TOCFL A1)、德語(初級程度)。
興趣: 各領域的人工智慧、機器學習和深度學習(例如電腦視覺、影像處理、生成模型和演算法、訊號處理)及其實現
志工經歷
副會長,國立陽明交通大學印尼學生會
2024 年 8 月 - 2025 年 7 月- 協助學生會會長籌劃與執行各項活動。
- 引導並協助新生與在校印尼學生適應校園生活。
學生單位協調員,KKM-PPM UGM 單位 YO123
2021 年 7 月 - 2021 年 8 月- 領導一個由30名成員組成的學生團體。
- 在 50 天內為印尼日惹的鄉村社區規劃並實施 102 個計畫。
- 為當地社區賦權而製定的計劃有不同的目標領域,包括經濟發展、環境、技術、社會研究、公共衛生等。
NDDC 主席, Night Login
2020 年 11 月 - 2021 年 11 月- Night Login 資料科學和資料分析社群 (NDDC) 主席,該社群是資訊工程專業學生團體的一個部門。
- 為會員創建與數據科學和數據分析相關的培訓課程。
- 對會員進行培訓。