model-alignment

Here are 10 public repositories matching this topic...

Ethyros-AI / ModelCypher

ModelCypher - Decipher the high dimensional geometry of LLMs. An open source x-ray into LLM representation structure.

deep-learning geometry machine-learning-algorithms lora representation-learning procrustes manifold-learning model-alignment ai-safety mlx cka jax apple-silicon llms model-merging

Updated Jul 14, 2026
Python

pablo-chacon / Spoon-Bending

Star

Educational analysis of LLM alignment, safety behavior, and framing-sensitive response patterns.

research model-alignment interpretability educational-project ai-alignment gpt4 large-language-models llm prompt-engineering reasoning-patterns gpt5 safety-research ai-bias context-engineering

Updated Nov 4, 2025

kevinscaria / TarGEN

Star

Targeted Data Generation with Large Language Models

nlp alignment nlp-machine-learning model-alignment synthetic-dataset-generation datagen datageneration large-language-models llm chatgpt

Updated Jun 25, 2024
Jupyter Notebook

karloks2005 / JailbreakLab

Star

Test and evaluate Large Language Models against prompt injections, jailbreaks, and adversarial attacks with a web-based interactive lab.

react docker kubernetes jailbreak model-alignment machine-learning-security ai-security fastapi huggingface prompt-injection llm-security llm-safety security-research-tool ai-evaluation-framework adversarial-ai prompt-defense llm-red-teaming

Updated Mar 27, 2026
Python

Ayush-2703 / Large_languaage_Models

Star

A comprehensive blueprint for Large Language Models. A rigorous curriculum covering transformer architectures, pre-training dynamics, parameter-efficient fine-tuning (PEFT), RAG orchestration, model quantization, evaluation, and alignment.

transformer lora quantization model-alignment fine-tuning rag large-language-models prompt-engineering llms generative-ai rlhf fine-tuning-llm large-language-models-llms

Updated Sep 5, 2026
Python

nunofachada / simoututils

Star

SimOutUtils - Utilities for analyzing time series simulation output

Updated Aug 18, 2017
MATLAB

Jeremyyny / Value-Spectrum

Star

Value-Spectrum: Quantifying Preferences of Vision-Language Models via Value Decomposition in Social Media Contexts

benchmark social-media model-alignment human-values large-language-models llms vision-language-model model-preference

Updated Jun 4, 2025

infinition / z-manifold

Sponsor

Star

Constrained adaptation of language models on a manifold of valid adapters, studied as a safety mechanism: poisoning resistance, out-of-distribution detection, and few-shot regularization, by construction rather than by heuristics.

deep-learning manifold-learning model-alignment ai-security out-of-distribution large-language-models arxiv-paper poisoning-defense lora-safety fine-tuning-safety

Updated Aug 26, 2026
Python

nicolbl95 / course-summary-post-training-llms

Star

French course summary on LLM post-training, covering SFT, DPO, reinforcement learning, preference optimization, and model alignment.

reinforcement-learning model-alignment post-training sft dpo large-language-models llm rlhf supervised-finetuning direct-preference-optimization

Updated Aug 3, 2026
Python

habibzahid203-web / day13-dpo-alignment-trl

Star

Aligning an instruction-tuned Llama 3.2 model to a professional brand voice using Direct Preference Optimization (DPO) with TRL — no separate reward model required.

nlp machine-learning llama model-alignment ai-safety preference-learning dpo huggingface trl rlhf direct-preference-optimization llm-alignment

Updated Sep 2, 2026
Jupyter Notebook

Add this topic to your repo

To associate your repository with the model-alignment topic, visit your repo's landing page and select "manage topics."

Learn more