gpt-2-model

Mechanistic analysis of a GPT-2–like model exploring the compositionality gap in transformers. Using Logit Lens and Causal Tracing, the study identifies and overcomes a deep-layer bottleneck via dataset enhancement addressing the stated Compositionality Gap (NeurIPS24).

A C# library and examples for building, training, and experimenting with neural networks and machine learning models.

A simple CLI chat mode framework for local GPT-2 Tensorflow models

Fine tune (with SFT-mode) and evaluate GPT2 model on facebook's bAbi tasks.

The Memory Support Chatbox for Pregnant Women is a project aimed at providing support and information to pregnant women experiencing cognitive memory issues. Using the GPT-2 language model, the chatbox generates responses based on text data related to pregnancy and memory issues.

A basic Learning Management System (LMS) built using Python, gRPC, and SQLite. The project implements Raft for consensus and fault tolerance, consistency. And a small sized LLM for tutoring support.

A collection of Generative AI projects built using Transformer models, including a creative AI Storyteller and a BERT-based Question Answering system. These projects demonstrate practical implementation of text generation and extractive QA using Hugging Face Transformers and Python. Showcases real-world NLP applications with model evaluation and an