Mohd Faizy

AI Research Feed

Curated notes on industry-shaping research and engineering breakthroughs.

LIVE UPDATES

AI-CURATED INSIGHTS

FEATURED

Frontier Model July 2026

Anthropic Claude Fable 5: Redefining Frontier Intelligence

Anthropic's release of Claude Fable 5 establishes a new paradigm for foundational models. Leveraging a highly optimized mixture-of-experts architecture and extended context window capabilities, Fable 5 demonstrates state-of-the-art performance across complex logical reasoning, zero-shot system design, and autonomous multi-step code generation.

Explore Research

Trending Share

Open Source Meta AI

Meta Llama 3

Meta released Llama 3, the next generation of their state-of-the-art open-source large language model. With models up to 70B parameters, it introduces significant improvements in reasoning, code generation, and instruction following over Llama 2.

Read Deep Dive

Science AI DeepMind

AlphaFold 3

Google DeepMind unveiled AlphaFold 3, an AI model that predicts the structure and interactions of all life's molecules with unprecedented accuracy. This represents a monumental leap in structural biology and drug discovery capabilities.

Read Deep Dive

Architecture Context Memory

Infini-attention (Google)

Leave the million-token limit behind. This technique introduces a compressive memory algorithm into the standard attention mechanism, allowing Transformers to process infinitely long context sequences with bounded memory footprints.

Read Deep Dive

Quantization 1-bit Era

BitNet b1.58 (Microsoft)

The end of Matrix Multiplication in LLMs. A ternary weight parameterization mapping that achieves identical performance to 16-bit precision models, while slashing memory needs and latency exponentially for purely arithmetic-free inference.

Read Deep Dive

Alignment Tuning

Direct Preference Optimization

Bypassing RLHF. DPO represents the shift away from brittle reinforced reward networks, substituting it with a closed-form algorithm that enforces human preference natively into the language model's policy using standard binary cross-entropy.

Read Deep Dive

Compute Opt Context

Ring Attention with Blockwise Compute

Solving the quadratic attention explosion by distributing long sequences across a ring of GPU hosts. This paper proves we can scale context windows over 10 million tokens by calculating self-attention block-by-block asynchronously.

Read Deep Dive

Hybrid Arch SSMs

Jamba: Joint SSM + Transformer

A novel architecture mixing Mamba (State Space Model) layers with traditional Transformer blocks. This breakthrough allows production-ready enormous contexts with near-instant caching and linear scaling, merging the best of two worlds.

Read Deep Dive

Self-Alignment RLHF-Alternative

Self-Rewarding Language Models

Shattering the human limitation barrier. This Meta research shows how advanced LLMs act as their own reward judges, perpetually evaluating and refining their outputs, outstripping the quality of datasets entirely produced by humans.

Read Deep Dive

Inference Acceleration

Speculative Decoding

A paradigm shift for massive scale inference latency. By linking a fast 'draft' model to speculatively compose sequences for a massive 'oracle' model to verify in parallel, LLMs can output text 2-3x faster with mathematically strictly zero accuracy loss.

Read Deep Dive

RNN Revival Linear Scaling

RWKV (Linear RNNs)

Receptance Weighted Key Value network scaling. RWKV combines the highly parallelizable training mechanics of a Transformer with the highly efficient O(1) inference structure of RNNs, representing one of the best open-weight linear attempts online.

Read Deep Dive

Swipe to explore breakthroughs

View All Discoveries

About Me

AI/ML Engineer · Self-taught · Research-driven · Based in New Delhi

Personal Journey Available

Who am I?

I'm a Data Science enthusiast holding an M.Tech in Electronics & Communication Engineering from Jamia Millia Islamia University, New Delhi.

As a self-taught programmer, I specialise in NLP, Large Language Models, Agentic AI, and Retrieval-Augmented Generation (RAG).

Technologies Studied & Applied

LLM Research

Transformers Infini-Attention Quiet-STaR RWKV Jamba SSM Spec. Decoding LLaMA 2 Mistral-7B GPT-4 Architecture LoRA (Fine-Tuning)

NLP & Generative AI

BERT GPT-2 (scratch) DPO / RLHF LangChain LangGraph (Multi-Agent) Agentic RAG FAISS Vector Search RAGAS Framework

Computer Vision

YOLOv3 Siamese Nets Medical Imaging Emotion AI CNNs (Keras) GANs (Deepfakes)

MLOps & Infrastructure

MLOps Pipelines Kubernetes (Minikube) ArgoCD (GitOps) Jenkins CI/CD AWS Deployment Prometheus & Grafana ELK Stack Observability AstraDB Integration

Neural Networks

AI/ML Engineer

Self-taught

50+

Projects

Years

15+

Certs

1.2K+

Commits/Yr

M.Tech

Electronics & Communication Engineering

Jamia Millia Islamia, New Delhi

Master of Technology · 2017 – 2019

Specialisation in VLSI Design 8.6 CGPA

B.E

Electronics & Communication Engineering

Jamia Millia Islamia, New Delhi

Bachelor of Engineering · 2012 – 2016

First Division Distinction 72%

Diploma

Electronics & Communication Engineering

Jamia Millia Islamia, New Delhi

Diploma · 2009 – 2011

The origin of my "Silicon to Software" journey. This rigorous hands-on hardware training cultivated my systems-level thinking, forming the bedrock for my current work in deploying highly-optimized neural networks on edge devices.

Hardware Foundations

First Division with Honors 84%

Academic Projects

Hardware & VLSI Background

IC Routing Optimization using Fully Connected Neural Networks (M.Tech) Developed an innovative approach to integrated circuit routing using deep learning techniques. The system achieved state-of-the-art performance in routing optimization.
Floating Point Multiplier & Simulation - VHDL ISE™ (B.E.) Designed and implemented a high-performance floating-point multiplier for digital signal processing applications. The project focused on FPGA implementation and optimization.
PIC Controller Microcontroller Based Electronic Lock System (Diploma) Developed a password-protected electronic lock system using PIC16F877A microcontroller. Features include keypad interface, LCD display, and secure access control.

Core Tech Stack

Actively Used

Python

PyTorch

🤗

LangChain

LangGraph

Docker

MLflow

Currently exploring

Diffusion Models Responsible AI Multimodal LLMs

Projects

Showcasing 50+ AI/ML projects across various domains - from production AI systems to research implementations. Featured below are my latest production-ready projects.

Deep Learning

AI Systems

Production Ready

More Projects

COVID-19 X-Ray

PyTorch Detection

Traffic Signs

Deep Learning Keras

SETI Signals

Outer Space Radio

Applied LLMs

End-to-end Curriculum

NLP & ML Survey

300+ Papers

DL Drizzle

AI/ML Learning Hub

DataScience

Core ML/DL Projects

COVID-19 Analysis

Data Visualisation

Tumor Diagnosis

Exploratory Analysis

Python Viz

Plotting Toolkit

Data Analysis

Advanced EDA

Coursera ML

Python Implementations

Production AI Systems

15+

Computer Vision

12+

NLP & GenAI

20+

ML & Data Science

Explore All 50+ Projects

GitHub

Open-source contributions, AI experiments, and collaborative projects. Building the future of AI, one commit at a time.

76+ Repositories

218+ Stars

Open Source

@mohd-faizy

AI/ML Engineer & Open Source Contributor

Repositories 76+

Total Stars 218+

Followers 60+

Contributions 225+

Visit GitHub

Commit Activity

1,247

Commits this year

Languages

Python 65%

Jupyter 20%

Pytorch 15%

Contribution Activity

Less

Probabilistic-Deep-Learning-with-TensorFlow

Public

Probabilistic Deep Learning finds its application in autonomous vehicles and medical diagnoses. This is an increasingly important area of deep learning that aims to quantify the noise and uncertain...

Jupyter Notebook TensorFlow

69 34

View Repository →

Developing-Large-Language-Models

Public

Dive into LLM development! Learn cutting-edge techniques behind models like OpenAI's GPT-4, Meta's LLaMA 2, Mistral-7B, and Anthropic's Claude. Master PyTorch, build transformers, & fine-tune pre-t...

Jupyter Notebook LLM

1 0

View Repository →

GPT1-From-Scratch

Public

This project implements GPT-1 using PyTorch, focusing on foundational transformer architectures for natural language processing tasks.

Python GPT

0 0

View Repository →

Natural_Language_Processing_in_Python

Public

This repository contains the code and resources for the "Natural Language Processing in Python". This repository contains the core skills you need to convert unstructured data into valuable insight...

Jupyter Notebook NLP

1 0

View Repository →

Agentic_AI_using_LangGraph-_MCP

Public

Agentic AI framework built using LangGraph and Multi-Agent Control Plane (MCP) for building structured, goal-driven multi-agent systems.

Jupyter Notebook Agentic AI

0 0

View Repository →

GenAI-with-Langchain-and-Huggingface

Public

This repo is the comprehensive guide, covering Langchain integration with Huggingface models. Learn to build, deploy, and optimize cutting-edge AI applications through hands-on projects and real-wo...

Jupyter Notebook GenAI

0 0

View Repository →

Reinforcement_learning

Public

Exploring the fundamentals of reinforcement learning (RL) to build agents capable of navigating complex real-world environments and enhancing the training of large language models (LLMs).

Jupyter Notebook RL

0 0

View Repository →

PyTorch-Essentials

Public

Welcome to the PyTorch Essentials repository! This Repo aims to cover fundamental to advanced topics related to PyTorch, providing comprehensive resources for learning and mastering this powerful deep learning framework.

PyTorch Tutorial

3 1

View Repository →

LLMs_Applications_with_LangChain

Public

Build impactful LLM applications, including RAG workflows and agentic systems, using the LangChain framework!

Jupyter Notebook LangChain

0 0

View Repository →

Let's Collaborate!

Interested in contributing to AI/ML projects? Check out my repositories and let's build something amazing together.

Follow on GitHub Get in Touch

Certifications

Continuous learning through 15+ certifications from industry leaders.

15+

Certifications

Providers

2024

Latest

Deep Learning Specialization

Coursera • 2023

TensorFlow Developer

Google • 2023

Machine Learning

Stanford • 2022

AI for Everyone

Coursera • 2022

Python for Data Science

IBM • 2021

Data Analysis

Google • 2021

Computer Vision

DeepLearning.AI • 2021

Natural Language Processing

Coursera • 2020

SQL for Data Science

Coursera • 2020

AWS Machine Learning

Amazon • 2020

Algorithms Specialization

Stanford • 2019

MLOps Fundamentals

Google Cloud • 2024

Neural Networks & Deep Learning

DeepLearning.AI • 2019

Statistics for Data Science

Coursera • 2019

Docker & Kubernetes

Udemy • 2024

Coursera (8) Google (3) Stanford (2) DeepLearning.AI (2)

AI / ML Engineer

AI Research Feed

Anthropic Claude Fable 5: Redefining Frontier Intelligence

Meta Llama 3

AlphaFold 3

Infini-attention (Google)

BitNet b1.58 (Microsoft)

Direct Preference Optimization

Ring Attention with Blockwise Compute

Jamba: Joint SSM + Transformer

Self-Rewarding Language Models

Speculative Decoding

RWKV (Linear RNNs)

About Me

Who am I?

Electronics & Communication Engineering

Electronics & Communication Engineering

Electronics & Communication Engineering

Hardware & VLSI Background

Core Tech Stack

Projects

More Projects

COVID-19 X-Ray

Traffic Signs

SETI Signals

Applied LLMs

NLP & ML Survey

DL Drizzle

DataScience

COVID-19 Analysis

Tumor Diagnosis

Python Viz

Data Analysis

Coursera ML

GitHub

@mohd-faizy

Commit Activity

Languages

Contribution Activity

Featured Repositories

Probabilistic-Deep-Learning-with-TensorFlow

Developing-Large-Language-Models

GPT1-From-Scratch

Natural_Language_Processing_in_Python

Agentic_AI_using_LangGraph-_MCP

GenAI-with-Langchain-and-Huggingface

Reinforcement_learning

PyTorch-Essentials

LLMs_Applications_with_LangChain

Let's Collaborate!

Certifications

Deep Learning Specialization

TensorFlow Developer

Machine Learning

AI for Everyone

Python for Data Science

Data Analysis

Computer Vision

Natural Language Processing

SQL for Data Science

AWS Machine Learning

Algorithms Specialization

MLOps Fundamentals

Neural Networks & Deep Learning

Statistics for Data Science

Docker & Kubernetes

Read the Future.

Understanding Transformers: The Architecture That Changed AI

Contact

Send Message

Connect With Me