This repository contains records of various experiments with large language models (LLMs) exploring use-cases, prompt engineering strategies and approaches, and more.

1 day ago · Despite widespread adoption in deployed LLM systems, system/user prompt separation fails to provide a reliable instruction hierarchy, with models inconsistently getting confused by even simple …

Sep 27, 2023 · As you embark on the journey of launching an LLM-powered feature and innovating further, we recommend running the following types of experiments at launch and post launch of the …

Jun 10, 2025 · Learn how to use LLM Observability's Experiments feature to create, monitor, and troubleshoot experiments for developing your LLM applications.

A large language model (LLM) is a language model trained with self-supervised machine learning on a vast amount of text, designed for natural language processing tasks, especially language generation. …

Jun 4, 2024 · Commonly-used benchmarks suggest that open-weight LLMs like Llama-3-70b, Mixtral-8x7b, DBRX, and Command-R-Plus are well on their way to catching up to the frontier. For example, …

Aug 28, 2025 · This LLM evaluation guide covers the basics of LLM evals, popular LLM evaluation metrics and methods, and different LLM evaluation workflows, from experiments to LLM observability.

Dec 24, 2023 · Large Language Models (LLMs) have demonstrated impressive potential to simulate human behavior. Using a causal inference framework, we empirically and theoretically analyze the …

Experiments w/ ChatGPT, LangChain, local LLMs. Contribute to AUGMXNT/llm-experiments development by creating an account on GitHub.

🧩 LLM Fundamentals covers essential knowledge about mathematics, Python, and neural networks. 🧑‍🔬 The LLM Scientist focuses on building the best possible LLMs using the latest techniques. 👷 The LLM …