Final poster session

We thank our sponsors: Forethought, Hudson River Trading, Hugging Face, and Sky9 Capital, for supporting the poster session!

The poster session was held at the McCaw Hall and Ford Gardens from 11 AM to 3 PM on Monday, June 10th, 2024.

Prizes

Congratulations to the following teams, who produced exceptional, prize-winning projects!

Sponsor's prize for best poster

Student choice for best poster

Custom Projects

Project nameAuthors
AmzBERT: Enhanced Multi-Label Sentiment Classification for E-commerce Product ReviewsZack Seifert
Weakly Supervised Automated Language Model Red-Teaming to Identify Likely Toxic PromptsHoujun Liu
Patent Classification Using Large Language ModelsLuke Mizuhashi
Text as outcome: Topic models within a causal inference frameworkJuliette Coly
Mining Molecular Logics through Human Language: Predicting and Decoding Transcription Factor Logics on Gene Expression through LLM and transformerGyu (Gyuhyeon) Kim
From Infant to Toddler to Preschooler: Analyzing Language Acquisition in Language ModelsYash Shah
Using Iterative Back-Translation to Improve Neural Poetry TranslationAndrew Chen
Interpreting parking signs with lightweight large language models (LLMs)Uche Ochuba
Exploring Themes and Outliers in CFPB Consumer ComplaintsJonathan Hague
Intelligent Interactive Large Language Model Planner: Responsive Personalized HomeRobotAngel Zhang, Gadi Mark Sznaier Camps
Classification of clinical syndromes from patient-reported symptoms on social mediaEvan Maestri
Transfer learning in audio-based emotion detection: surprising generalizability and limitationsShunyu Yao
ReaL Stories: RL for Adaptive AI StorytellingAditya Sood, Aniket Mahajan, Ayaan Chand
Tailor-Made or Off-the-Rack? Comparing Domain-Specific and General-Domain Language Models on a Financial NLP TaskIrina Alexandra Marton
Cross attention for Text and Image Multimodal data fusionDongyeong Kim
Comparative Analysis of Foundation Models for Hospital IntegrationSuhana Bedi, Miguel Fuentes
Active learning in DPO through gradient portfolio optimizationJosh Leib Kazdan, Ziang Song
GRAFT: Graph Retrieval Augmented Fine Tuning for Multi-Hop Query SummarizationSunny Yu, Natalia Kokoromyti, Sonya Shi Jin
Diverse LLM Approaches in Essay Scoring: A Comparative Exploration of Many-Shot Prompting, LLM Jury Panels, and Model Fine-TuningAlexa Sparks, Matias Hoyl, Rizwaan Malik
Optimizing Large Language Models to Solve Crossword PuzzlesIshan Mehta, Andrew Lipschultz, Ohm Patel
KAN-based Distillation in Language ModelingNick Mecklenburg
Handle With Care! A Mechanistic Case Study of DPO Out-of-Distribution ExtrapolationRyan Park
Punk or Funk: Understanding the Performance of RoBERTa on Music Genre ClassificationAndrew Bempong, Deveen Harischandra
Sparse Full-Rank MLPs for Increased Efficiency of Language ModelingAaryan Singhal, Quinn McIntyre
How Important is the Truth?Rehaan Ahmad, Joseph Tan
Catch Me If You DAN: Outsmarting Prompt Injections and Jailbreak Schemes with RecollectionAlice Guo, Grace Jin, Jenny Wei
Query based Multi-document Summarizer and Image SynthesizerGeeta Jakkamsetti
Finish Your Peas! Utilizing Multi-Label ImageClassification to Identify Food Items and Ingredients for Recipe Suggestions and Reducing Food WasteArianna Damiani, Prashaant Ranganathan
Engagement-based response selection for open-domain dialogueMarcelo Peña
FlowState: Composing foundation models and retrieval for issue priority level predictionAlex Gilbert, Gustavs Zilgalvis
Beyond IID Constraints: A Novel Approach to Identity Preference OptimizationAmirhossein Afsharrad
Intrinsic Systematicity Evaluation: Evaluating the intrinsic systematicity of LLMsAyush Chakravarthy
Numerous Multi-Pivot and Chained Pivot NMT for Low-Resource Language TranslationCees Armstrong, Kevin Reso
Enhancing Language-Concordant Clinical Text Translation with Zero-shot NERIvan Lopez, Min Woo Sun
Better Call Sheared-LLaMA-2.7B: Optimized Summarization for Legal DocumentsVarun Madan, Arunima Srivastav
Adapting Listen, Attend, and Spell to Enhance Brain-Computer Interfaces for Speech DecodingDylan Iskandar, Brian Ni, Vedant Singh
Narrative Detection Across Nations in Online Social Media DiscourseSungbin Kim, Khaled Messai, Vikram Srinivasan
The First Proteinbender: A Novel "Structure-based Protein Search Engine"Ethan Zhang, Saahil Sundaresan, Zane Chan
Investigating Language Model Cross-lingual Transfer for NLP Regression Tasks Through Contrastive Learning With LLM AugmentationsRaghav Ganesh, Raj Palleti
Chinese Poem Generator with Prefix ControlYitong Lu
DeviceBERT: Applied Transfer Learning With Targeted Annotations and Vocabulary Enrichment to Identify Medical Device and Component Terminology in FDA Recall SummariesMiriam Farrington
L-LLM: Large Language LEGO ModelsAlex Wang, Calvin Laughlin
Adapting BERT to non-Western Dialects: A Case Study on Nigerian Pidgin English SlursSathvik Nori, Adrian Adegbesan
Words and Wins: Enhancing Game Play with LLM Fine-Tuning by RLXuanzi Chen, Zhengjia Huang
From Preferences to Principles: Automated Principle Generation for Language ModelsWilliam Fang, Vikram Sivashankar
From Lies to Insights: Expanding and Understanding the LIAR DatasetFelix Zhan
HieroLM: Egyptian Hieroglyph Recovery with Next Word Prediction Language ModelXuheng Cai, Erica Zhang
Analyzing Sophia's Gradient Distributions in Language Model PretrainingRaghav Kapoor
Investigating Improvement to English-Tigrinya Translation via Transfer Learning Over Varying LanguagesAbel Dagne, Sheden Andemicael
Quality or Quantity? Comparing Domain-Adaptive Pre-training Approaches for Language Models with Mathematical UnderstandingChristine Ye, Alexandre Acra
Knowledge-Enhanced Language Models: A Comparative Study of RAG and Embedding MethodsAdarsh Ambati, Nikash Chhadia
Optimizing Language Models for Safe Online Discourse: Developing Metrics and Models for Detoxifying Internet ConversationsSteven Li, Steven Le
Making Silicon SingKadija Ismail, Imen Kedir
Active Learning for Efficient NLP TrainingDaniel Lee, Thomas Yim, Ibrahim Dharhan
Character Understanding in Literary Texts: Leveraging TinyLlama for Advanced Character Analysis in the LiSCU DatasetKatherine Wong
arXivBot: A Large Language Model Chatbot That Has High Factuality and Coverage by Few-Shot Grounding on arXivXiaofeng Tang
SENTINEL: A Heterogeneous Ensemble Framework for Detecting AI-Generated Text in the Era of Advanced Language ModelsNatalie Cao, Haocheng Fan
Predicting Stock Market Trends from News Articles And Price Trends using TransformersKasra Naftchi-Ardebili, Karanpartap Singh
Merging ‘Personas’ in Multi-Agent Systems of Language ModelsAndy Dai, Sriya Mantena
Critical Learning Periods for Second Language Acquisition in Neural Language ModelsDaniel Wurgaft, Jerome Han
Enhancing Practice Problem Retrieval with Deep Learning: A Rewriter-Retriever-Reranker ApproachCharles Joyner, Ronny Junkins, Mack Smith
Can LLMs Survive in the Desert? Evaluating Collaborative Capabilities of Generative Agents on a Classic Team-Building ProblemYash Narayan, Daniel Shen, Ethan Zhang
SceneGrounder: Natural Language Scene Descriptions and Retrieval Augmented Generation for 3D Visual TasksHuy Nguyen, James Brown
RubricEval: A Scalable Human-LLM Evaluation Framework for Open-Ended TasksVineel Bhat
Medical Named Entity Recognition and Relation Extraction from Clinical NotesAmeya Jadhav, Sreyana Kukadia
The Invisible Author: Mapping AI Penetration in News JournalismJun Wang, Andrew Zhang
Developing a GPT-Based Autonomous Agent With Novel Workflow Execution CapabilitiesKenny Lam, Vaishnav Garodia
Improving speech brain-computer interface with conversation contextBrian Lee, Allison Tee
Negotiation Copilot: Exploring Ways to Build an AI Negotiation AssistantWinson Cheng, Abhinav Agarwal
AuRA (Automated Retrieval-Augmented Generation (RAG) System Development)Robby Manihani
KoWhisper: Efficient Bilingual Speech-to-Text for Edge DeploymentJason Park, Harshit Gupta
Enhancing AI Creativity: A Multi-Agent Approach to Flash Fiction Generation with Small Open-Source ModelsAlex Wang, Berwyn Berwyn, Jermaine Zhao
UltimateMedLLM-Llama3-8B: Fine-tuning Llama 3 for Medical Question-AnsweringJayson Meribe, Sean Zhang
PROCEED: Performance Routing Optimization for Cost-Efficient and Effective DeploymentLichu Acuña, Odin Farkas
Improving Spanish-Mapudungun Translation through Transfer LearningEban Ebssa
EDU-RAG: A RAG Benchmark with Web-enhanced Content in Education Domain. Will RAG Help AI Tutor?Xinxi Chen, Jingxu Gao
Mapping the Mind: Knowledge-Graph Augmented RetrievalNicholas Vo
Learning Semantic Complexities of NYT ConnectionsEmily Zhang, Yanan Jiang, Peixuan Ye
SuLaLoM: Structured Classification of Tabular Data with Large Language ModelsSu Kara
AdaVid: Adaptive Video-Language PretrainingChaitanya Patel
PragMaBERT: Analyzing Pragmatic Markers in Political SpeechMatt Wise, Houda Nait El Barj
Robotic AssistEMT: An EMT ChatbotAanika Atluri, Sarah Barragan, Anusheh Chaudry
Knowledge Distillation of Deep Language Models for Electrification Information Extraction from Building PermitsTony Liu
Shared Representation of Language in Broca’s Area and Large Language ModelsAlisa Levin, Benyamin Meschede-Krasa, Yun Hwang
ModelFusionJoong Kun Lee
PragMaBERT: Analyzing Pragmatic Markers in Political SpeechMatt Wise, Houda Nait El Barj
Comparative study between addition of one MAMBA block to Wav2Vec2 Pretrained model and Vanilla Pretrained modelPuchiss Panitpotjaman
Multi-Task Alignment Using Steering VectorsCharles Li, Nahum Maru
Project Oracle: Autoregressive Future Event Prediction with Sequential Modeling and TransformersBrian Wu, Katherine Wang, Ismail Mardin
DelT5: Dynamic Token Deletion for Efficient Byte-level Language ModelsJulie Kallini
Formally Verify Generated CodeLivia Sun
Fine-tuning Digital Agents with BAGEL TrajectoriesAlfred Yu, An Doan
Optimal Brain Projection: Neural Network Compression using Mixtures of SubspacesDaniel Garcia
Mistriply: Encoding Human Algorithmic Processes into LMs for Teaching and ComputationHarviel Kyle Arcilla, Colette Do
Item Difficulty Modeling for a Sentence Reading Efficiency Task with Language Model SimulationsWanjing Anya Ma
Improving Speech-to-Text Brain-Computer Interface Performance with Neural Decoders and Large Language ModelsLaywood Fayne, Mohammad Rehan Ghori
Advancing Automated Content Moderation using Large Language ModelsHarshit Gupta, Sidhant Bansal, Sneha Jayaganthan
Leveraging Language Models for Multiclass Classification of Unfair Clauses in Terms of ServiceShaurnav (Joy) Ghosh, Shrish Janarthanan
Talk To Me, Your Virtual AI Therapist: Advancing AI-Driven Psychotherapeutic Engagement with Sentiment AnalysisGeorge Birikorang, Nathan Paek, Zoe Lynch
The impact of LLM pruning for fine-tuningVarun Shanker, Sarah Chung
Curriculum Learning with TinyStoriesMichail Christiaan Melonas
Beyond Single Commands: Evaluating LLMs on Multiple Instruction SequencesSagnik Bhattacharya, Vaastav Arora, Prateek Varshney
FinRAG: A Retrieval-Based Financial AnalystKrrish Chawla, Allen Naliath
ClimateGrantLLM: Benchmarking grant recommendation engines for natural language descriptions of climate resilient infrastructure capital projectsBhumikorn Kongtaveelert, Auddithio Nag, Peter Li
JEDI: Justifiable End-dialogue Driven Interaction for NPC Entities in Role-Playing GamesWilly Chan, Omar Abul-Hassan, Sokserey Sun
Efficient Translation of Natural Language to First-Order Logic Using Step-by-Step DistillationAliyan Ishfaq, Shreyas Sharma
Enhancing Partisanship Prediction in Congressional SpeechesAmelia Leon, JB Jong Beom Lim, Sherry Yang
Needle in a Haystack: Probing Transformer Capabilities to Recognize Non-Star-Free LanguagesRichard Gu, Sambhav Gupta, Andy Tang
Forticode: A Benchmark for Evaluating the Robustness of Code Generation Models Against Adversarial Syntax Preserving MutationsAmrit Baveja, Anant Singhal
Disarming Sleeper Agents: A Novel Approach Using Direct Preference OptimizationKatherine Worden, Jeong Shin
Now You See Me: Vision-enhanced BERT for obfuscated text abuse detectionDylan Zhou
The Potential of Large Language Models in Assisting Data Augmentation for East Asian Digital HumanitiesFengyi Lin
Expanding Horizons in RAG: Exploring and Extending the Limits of RAPTORAlex Laitenberger
The Shades of Meaning: Investigating LLMs’ Cross-lingual Representation of Grounded StructuresPinlin [Calvin] Xu, Garbo Chung
FolioLLM: Constructing portfolio of ETFs using Large Language ModelsAndrey Popov, Oleg Roshka
Integrating Domain Knowledge for Financial QA: A Multi-Retriever RAG Approach with LLMsYukun Zhang, Stefan Elbl Droguett, Samyak Jain
Integrating Extra Linguistic Meaning into the BERT FrameworkRiley Carlson, Bradley Moon, Ishaan Singh
A Contextual Approach Towards Financial Sentiment AnalysisEmma Sun
Enhancing Construction Project Management through a Cross-Modal Retrieval SystemJayadev Rajan
Large language models for sustainable food designAnna Thomas
News to Numbers: NLP Stock Return PredictionsShree Reddy, Henrique B. N. Monteiro, Lucas Werneck
Apollo: A Large Multi-Modal Model Capable of Sampling Videos at 8fpsOrr Zohar
Analyzing the Effectiveness of Morphologically Motivated Tokenization on Machine Translation for Low-Resource LanguagesAbhishek Vangipuram, Emiyare Ikwut-Ukwa, William Huang
Hivemind: An Architecture to Amalgamate Fine-Tuned LLMsMatthew Mattei, Matt Hsu, Ramya Iyer
Leveraging Long Context for Customer SupportIan Lim
Course Recommendation ChatbotNaama Bejerano, Emma Troast
From Headlines to Bottom Lines: Leveraging Earning Releases and News Headlines to Predict Stock Price MovementAnanya Krishnan, Jinny Chung, Charles Shaviro
Leverage Augmented Large Language Models to build Hyper Personalized Recommendation SystemsViveak Ravichandiran
Retrieval Augmented Verilog GenerationJoseph Rejive
Parsing FDA label data with LLMsJake Silberg
FAST: Finetuning Agents with Synthetic TrajectoriesFlor Lozano-Byrne
Diving Under the Hood: Exploring LLM Conceptual Understanding Through Latent EmbeddingsKelvin Nguyen
Korean-English Neural Machine Translation with Language Style ControlJiwon Jeong, Hyejin Lee, Youjin Song
Using Segmented Novel Views, Depth, and BERT Embeddings for Training in Robot LearningMatt Strong
How Much Attention is "All You Need"?Ignacio Fernandez, Duru Irmak Unsal
A case for pre-training in Compositional Generalization tasksAhmad Jabbar, Rhea Kapur
RubricEval - Scalable Human-LLM Evaluation of LLMs on Open-Ended Tasks Using Human-Written RubricsStella Zhang
MuRST: Multilingual Recursive Summarization TreesTarini Mutreja, Saron Samuel, Humishka Zope
Simulating the Court: Legal Judgment Prediction through Relational LearningEin Jun
An Exploration of Transferring Domain ExpertiseJonathan Paul Hsu
Posetta: Language-Guided Protein DesignHaotian Du, Jingjia Liu, Tianyu Lu
Self Reward ScalingArjun Chandran
Optimizing Human-Agent Interaction: Evaluating Diverse Strategies for Human Input in the OptiMUS LLM Agent SystemIdil Defne Çekin, Isaiah Hall
A Neuro-Symbolic Integration of LLMs and SMT-solvers for Trustworthy Logical ReasoningHarun Khan
Experiments on Multi-Task Learning Framework over BERT for Performing Sentiment Analysis, Paraphrase Detection, and Semantic Textual Similarity SimultaneouslyFlorence Chen
arXivBotAmr Sherif
Robust DPO with Convex-NN on Single GPUMiria Feng
DNACLIP: Contrastive representation learning for joint embedding of DNA and natural languageBrian Kang
Taming Guidelines in the WildAnuj Iravane
Long Horizon Robotic Manipulation through Closed-Loop Mark-Based Visual PromptingDavid Ihim
Context-Aware Gesture Interpretation in Augmented and Virtual RealityTrishia El Chemaly
Reading Between the Minds: Context-Aware Brain-to-Text DecodingEllie Tanimura, Sarosh Khan
Clinical Text Summarization with LLM-Based EvaluationDaphne Barretto, Matthew Jin, Bora Oztekin
Beauty and a Beat: Comparing and Combining the Utility of Lyrical and Acoustic Features to Identify Genuine PlaylistsNaomi Eigbe
Tracing the Development of Word Meaning During TrainingShenghua Liu, Yiheng Ye
MoonSpeech - Training a tiny multi-modal LLMKrishna Dusad
Integrating Clinical Note Synthesis with Synthetic EHR Data for Enhanced Healthcare AnalysisJessica Yang, Riya Karumanchi
Automated Extraction and Detection of Selective Reporting in Publications of Landmark Cancer TrialsMaximilian Schuessler, Amanda Rodriguez, Selina Pi
An LLM-Based Recommender System for Scientific PapersVijay Josephs, Aaron Reed
Actions versus Objects: Understanding Gendering of Jobs through LanguageEcho Yan Zhou

Default Projects

Project nameAuthors
Enhancing minBERT for Multi-Task NLP: Architectural and Training InnovationsXinxie Wu
Enhancing multi-task fine-tuning on BERT-based modelXiaochen Xiong
Task-Specific Parameter Efficient Fine-Tuning for Improving Multitask BERTBrian K. Ryu
Adapt BERT on Multiple Downstream TasksRan Li
Post-Op BERT: Improving Gradient-Surgery on Imbalanced DataGiancarlo Ricci
Improving Semantic Meaning of BERT Sentence EmbeddingsTimothy Yao
Improving the Performance of BERT Using Contrastive Learning and Meta-LearningAkash Gupta, Justin Shen, Peter Westbrook
Fine-Tuning BERT for Multi-Task PredictionUma Dayal
Robust Adaptation of BERT using SMARTOzgur Cetin
Improving minBERT with Conditional Layer NormalizationMatan Abrams
Multi-task Learning with minBERTPraneet Bhoj
optiBERT: Fine-Tuning BERT for Optimal PerformanceJirah Taylor
Multitask Finetuning for MinBERTEthan Boneh
ConCATenation Curiosity: Evaluating Multitask Performance of minBERTPrithvi Krishnarao, Emily Redmond
Parameter Efficient Fine-Tuning for Multi-Task BERTZhen Wu, Genghan Zhang, Alexa Hu
Multi-task BERT Fine-Tuning with Gradient TricksHenry Ang
PowerBERT: Improving BERT with a Power Set Ensemble of Fine-Tuned Single and Multitask ModelsEric Lee, Kevin Song, Jeanette Han
PALs of MTL: Investigating Task Scheduling Algorithms in the Presence of PALsKris Jeong, Pauline Arnoud
BERT with LORA: Low-rank Adaptation Of Large Language ModelsTolu Oyeniyi
From BERT to Brilliance: An Analytical Approach to Advancing Multitask Learning for NLPAkea Pavel, Adrian Mendoza-Perez
Comparing BERT Fine-Tuning MethodsAdrian Stoll, Jennifer Ho, Daniel Tyshler
Dynamic Weight Adjustment for Multitask BERT: An Approach to Sentiment, Paraphrase, and Similarity TasksMarco Pizarro
Multitask training BERT for Sentiment Analysis, Semantic Textual Similarity, and Paraphrase DetectionFeiyang Kuang
BERT Multitask Methods for Low-Parameter Fine-TuningElton Manchester
miniBert UnleashedJohn Cao, David Kwentua
Implementing and Enhancing minBERT for Optimized Performance on Multiple Downstream Classification TasksPriti Rangnekar
Multi-BERT: Investigating Methods for BERT Multitask LearningZach Benton
Expanding minBERT’s Scope: Integrating SimCSE, Ensemble Learning, and PANDAYasmina Abukhadra, Samantha Liu, Hannah Norman
Parameter Efficient BERT Fine-tuningAng Li
Hybrid BERT: Sharing Layers for Multitask Performance with Fewer ParametersJake North, Jared Weissberg
Rhapsody on a Theme of Gradient Surgery: Variations to Improve minBERT for Multi-Task LearningChristian Femrite
minBERT Multi-Extended: Fine Tuning minBERT for Downstream TasksJayna Huang, Isabella Lee, Sophie Zhang
BEES: Bi-Encoder Ensembles with Simple Contrastive Learning and Smoothness Induced Adversarial RegularizationNithish Kaviyan Dhayananda Ganesh
minBERT and Downstream TasksBay Foley-Cox, David Wendt
Too SMART for your own good: Multitask Fine-Tuning pre-trained minBERT through Regularized Optimization and hyper-parameter optimizationProud Mpala, Wayne Chinganga
MathBERT: Increasing mathematical reasoning through Domain-Specific Fine-tuning and OptimizationJohn Founds, Carlos Santana
Implementing and Fine-Tuning BERT for Sentiment Classification, Paraphrase Detection and Semantic Similarity AnalysisAnqi Zhu, Antonio Torres Skillicorn, Kyra Sophie Kraft
BERT and Multitask LearningSureen Heer, Collin Jung, Adrian Molofsky
A Better Multitask BERT: Improving on Fine-TuningAndrea Hurtado, Sarah Teaw
Optimizing Multitask BERT: A Study of Sampling Methods and Advanced Training TechniquesAndrew Wu, Wesley Larlarb
YourBERT: Tailoring BERT for PrecisionPaolo Tayag, Jack Walter
Utilizing Enhanced Deep Contextualized Word Embeddings for Downstream TasksRenaldo Venegas, Ethan Yuen
BERT on Multitask Training: Bimodality, Ensemble, Round-robin, Text-encoding, and MoreJiaxiang Ma, Yuchen Deng
UntitledBetty Wu
Cooking A Multitude of Optimizations for BERT Multi-Task MasteryMichael Cho, Michael Peter Hong, Michael Marcotte
Multi-Dimensional BERT: Bridging Versatility and Specialization in Multi-Task LearningEmma Casey, Luke Moberly
Fine-tuning BERT for Multi-task LearningYutai Luo
Multitask and Task-specific Optimizations for minBERTJames Chen, Krish Parikh
Utilizing minBERT for Multiple Sentence-level TasksQianhui Zheng
(Multi-gate) Mixture of ExBertsO Sub Kwon
minBERT and Downstream TasksZhihua Cai
Fine BERTXavier Millan, Yuvraj Baheti, Andrew Nguyen
UnBERTlievable: How Extensions to BERT Perform on Downstream NLP TasksSophie Andrews, Naomi Boneh
PALs and MNRL: Adaptations for Multi-Task BERTLei Yin
Multitask BERT Fine-Tuning and Generative Adversarial Learning for Auxiliary ClassificationChristopher Sun, Abishek Satish
SMART Fine-tuningZikui Wang
SLOTH: Semantic Learning Optimization and Tuning Heuristics for Enhanced NLP with minBERTPhillip Miao, Cici Hou
Multitask Learning with BERTSanjaye Elayattu
An Exploration of Multi-Task Learning over minBERTChunming Peng, Max Yuan, Annie Wang
minBert with Cosine Similarity and PCGradXiyuan Wu, Alan Zhang
BERT: Battling Overfitting with Multitask Learning and EnsemblingJavier Nieto, Annabelle Jayadinata
Strategies for Building Semantic Classification Dataset with LLM and Active LearningJerry Chan
BERT Goes to School: Improving BERT Embeddings Through Curriculum-Based Contrastive Learning and Synonym-Based Data AugmentationArnav Gangal, Martin Pollack, Russell Tran
Bagging the Singular Value Decomposition - A Joint Implementation of LoRA and Bootstrap Aggregating as a Fine-tuning RegimeAndri Vidarsson, Jacob Thornton, Raphaëlle Ramanantsoa
Research on the Application of Deep Learning-based BERT Model with Additional Pretraining and Multitask Fine-TuningMuran Yu, Ricky Liu
My PAL BERT: Using Projected Attention Layers and Additional Fine-Tuning Strategies to Improve BERT’s Performance on Downstream TasksColin Michael Sullivan, Abhishek Kumar
Enhancing Multi-Task Learning with BERTJosiah Griggs
minBERT-based Multitask Model using PAL-LoRAXian Wu
Enhacing minBERT by Leveraging CosineEmbeddingLoss Fine-Tuning and Multi-Task Learning with Gradient SurgeryPeter De La Cruz, Mohamed Musa, Yahaya Ndutu
Orthogonal Projection Loss for Multi-Headed AttentionKyle McGrath
Enhancing Dev Accuracy with DoRAHayden Kim, Nilson Rodriguez Cadenas
SMARTer Multi-task Fine-tuning of BERTDisha Ghandwani, Aditya Ghosh, Rahul Kanekar
Tuning Up BERT: A Symphony of Strategies for Downstream TasksNick Soulounias
AllBERT: Mastering Multiple-Tasks EfficientlyThierry Rietsch, Joe Serrano
Beyond BERT: a Multi-Tasking Journey Through Sampling, Loss Functions, Parameter-Efficient Methods, Ensembling, and MoreAlycia Lee, Amanda Li
Enhancing BERT’s Performance on Downstream Tasks via Multitask Fine-Tuning and EnsemblingLianfa Li
minBert and Downstream TasksZhimin Tang
Multitask Contrastive Learning for Sentence RepresentationAbdulaziz Alharbi
BERT’s Got Talent: Advanced Fine-Tuning Strategies for Better BERT GeneralizationGrace Luo, Danny Lin
Separating Meaning From Weights in Sentence EmbeddingsHaibib Kerim
A multi-objective approach to improving accuracy and efficiency in multitask BERTArpit Singh, Amitai Porat, Lin Ma
Supercharging MinBERT with Contrastive Learning & Self-DistillationCécile Logé Baccari
Parameter-Efficient Adaptation of BERT using LoRA and MoELi-Heng Lin, Yi-Ting Wu
Exploring Multi-Task Learning with Unbalanced Datasets and Gradient SurgeryJulien Darve
Multitask minBERT with Parameter-efficient Fine-tuningZhuoqi (Charlie) Zhang
Enhanced BERT Adaptation: Ensembling LoRA Models for Improved Fine-TuningDenis Tolkunov
Parameter-Efficient Learning Strategies for Multi-Task Applications of BERTIrmak Sivgin, Mahmut Yurt
Efficient multi-task learning strategies for single BERTJiamin Sun, Xingjian Zhang
Exploring Transfer Learning and Multi-Task Learning: An Experimental Analysis of Diverse ArchitecturesSayali Sonawane
Improving Multi-Task BERT Fine-Tuning: Effective Methods and PracticesAmy Wang, Haopeng Xue, Xinling Li
minBERT and Downstream TasksZiyang Ding, Daniel Zou
BERT Multitask Learning in a Semi-Supervised Learning SetupDanhua Yan
BERTille, a multitask BERT model made in FranceAlexis Bonnafont, Malo Sommers, Salma Zainana
Enhancing BERT:The Effects of Additional Pretraining Using Downstream Task Relevant DatasetsChase Nwamu
Strategies for Optimization of minBERT for Multi-Task LearningAnkur Jai Sood, Cameron Heskett, Shinwoo Lee
How to make your BERT model an xBERT in multitask learning?Xingshuo Xiao
ComBERT: Improving Multitask-BERT with Combinations of Scale-invariant Optimization and Parameter-efficient Fine-tuningHarper Hua, Ruiquan Gao , Xinyi(Jojo) Zhao
Fine-tune miniBERT for multi-task learningGeo Zhang
Hybrid Multitask Learning with BERTAnna Mattinger
Improving minBERT on Downstream Tasks Through Combinatorial ExtensionsYichen Jiang, Ria Calcagno, Senyang Jiang
StudentBERT: Multitask Training with Teacher ModelsShang Jiang, Shengtong Zhang
Balancing Act: Evaluating the Interactions Between Multi-Task Learning, Cosine Similarity, and Adversarial RegularizationLeo Glikbarg, Dhafer Faishal
Build, Extend, Repeat, Triumph: Extensions to a BERT Multitask ModelOliver Lee, Ethan Hsu, Manat Kaur
Fasting NLP:Slimming Down Models with QLoRARicardo Carrillo
BEST-FiT: Balancing Effective Strategies for Tri-task Fine TuningElijah Kim, Rohan Sanda
Extending minBERT in a Multi-Task SettingJean-Philippe Lemay, Veljko Skarich, Joe Wang
Multi-task Learning for BERTXinyan He, Wei Zhao
Enhancing BERT with Adapter Fusion: A Strategy for Multi-Task Knowledge TransferHao Xu
Combining Contrastive Learning with Layer Utility Analysis and Experimental Multi-Task Finetuning to Improve mini-BERT PerformanceEllie Vela, Vionna Atef, Ethan Bogle
minBERTBryant Mendez Melchor, Gustavo Martinez
minBERT and Downstream TasksJiajing Luo
Parameter Efficient Fine Tuning in Multi-Task Learning with minBERTHavin E. Hosgur
BERTolomeu: Exploring Methods to Improve Downstream Task Performance with BERTFlora Yuan, Jack Zhang
Multi-Task Learning for Language Model Fine-TuningAnonto Zaman
PradrewBert: The Efficient OnePradyumna Saligram, Andrew Lanpouthakoun
Smarter BERT with Better Understanding and GeneralizationYujie Gao
Multitask BERT for Sentiment Analysis, Paraphrase Detection, and Semantic Textual SimilarityBrandon Ring
Triple Threat: Exploring Multi-task Training Strategies for BERTSally Zhu, Akaash Kolluri
NeuSemble: Neural Ensemble of Multitask Learning with minBERTYouzhi (Yousef) Liang
Bidirectional Encoder Representations from Transformers (BERT) with Mixture of Experts for Sentiment Analysis, Paraphrase Detection, and Semantic Textual SimilarityDavid D. Wu
Fine-tuning BERT for Multiple Downstream TasksJianhao Cai
Parts of MinBERTMonica Hicks, Megan Liu
Improving the performance of miniBERT and BERTaaR (BERT as a Recruiter)Prabhjot Singh Rai, Jared Isobe
Applying Multitask Fine-Tuning to Sentence-BERTAlvin Ayuyo
Investigation of BERT Fine-tuning StrategiesSheena Lai
BERT-Based Multi-Task Learning for Natural Language UnderstandingRay Ortigas
Fine-tuning and Gender Fairness of BERT ModelsKevin Rizk
Improving minBert using Multi-Task Fine-Tuning with cosine-similarityEun Sun Song
Exploring Efficient Learning of Small BERT Networks with LoRA and DoRAAditri Bhagirath, Moritz Bolling, Daniel Frees
Downsizing minBERT without hurting performanceNazar Khan
Leveraging PEFT Strategies for Improved Performance and Efficiency in minBERTMateo Quiros Bloch, Lara Seyahi, Susan Ahmed
Mastering minBERT: A True Balancing ActEmma Escandon, Alejandro Rivas, Daniela Uribe
Minh-BERTTaran Kota