Rohit Kumar's picture

6

Rohit Kumar

rohitdavas

·

https://rohitdavas.github.io

AI & ML interests

machine learning, computational neuroscience, deep learning, AI

Recent Activity

new activity 6 days ago

pytorch/SSD:Update app.py

reacted to TuringsSolutions's post with 👍 7 months ago

I developed a way to test very clearly whether or not a Transformers model can actually learn symbolic reasoning, or if LLM models are forever doomed to be offshoots of 'Socratic Parrots'. The results are in, undeniable proof that Transformers models CAN learn symbolic relationships. Undeniable proof that AI can learn its ABC's. Credit goes to myself, Claude, and ChatGPT. I would not be able to prove this without Claude or ChatGPT. https://www.youtube.com/watch?v=I8jHRgahRfY

replied to Jaward's post about 1 year ago

Retrieval-Augmented Generation (RAG) Redeemer of the "hallucination problem" It is fair enough to argue that "hallucinations" in LLMs are just mere reflections of what we humans occasionally do - well it gets worse as we get older, but these models are brain inspired, thus such behaviors are likely inherently unavoidable. After all, we are just dreamers trying make sense of this life. The best we can do is minimize and control it - but humanly how? By first feeding on relevant facts and then developing a habit that allows us to easily access those facts when needed. This is what RAG is all about - it's just a control mechanism that keeps the LLM aligned with reality and fact. But How Does RAG Work? Well, to some extent it is domain-specific but the overall workflow boils down to the following: 1. It makes use of a retrieval mechanism that hunts for facts relevant to a query - this involves an end-to-end backpropagation that leverages a retriever (Query Encoder + Document Index or Source of Truth) with a pre-trained generative model. 2. The generative model then uses the facts retrieved, performs some verification to give a more accurate response. To summarize, the RAG architecture houses a pre-existing knowledge source model (termed parametric memory), which then utilizes a Source-of-Truth model or vector indexed data (termed non-parametric memory) that is accessed by a pre-trained neural retriever, in order to produce more informed, contextually appropriate and factually correct responses. Sort of a "Genius Engine" if you might say. If only we humans could harness such, AGI would be much much sooner lol. In the meantime, I have been Jaward Sesay (Chinese name 苏杰 Sujie) - a young Sierra Leonean, aspiring AI Researcher. I like to read, share and try implementing AI research papers. Also like dunking on big tech while rooting for open-source. My mentor @karpathy, I dream of him following me back on X lol. Thanks.

View all activity

Organizations

Collections 1

models 13

rohitdavas/rl_course_vizdoom_health_gathering_supreme

Reinforcement Learning • Updated Oct 8, 2023

rohitdavas/ppo-lunarlandar

Reinforcement Learning • Updated Oct 8, 2023

rohitdavas/poca-SoccerTwos

Reinforcement Learning • Updated Oct 7, 2023 • 31

rohitdavas/a2c-PandaReachDense-v3

Reinforcement Learning • Updated Oct 1, 2023

rohitdavas/ppo-Pyramids

Reinforcement Learning • Updated Sep 26, 2023 • 29

rohitdavas/ppo-SnowballTarget

Reinforcement Learning • Updated Sep 26, 2023 • 33

rohitdavas/pixelcopter-reinforce

Reinforcement Learning • Updated Sep 18, 2023

rohitdavas/cartpole-reinforce

Reinforcement Learning • Updated Sep 18, 2023

rohitdavas/dqn-SpaceInvadersNoFrameskip-v4

Reinforcement Learning • Updated Sep 10, 2023

rohitdavas/Taxi-V3-with-Q-Learning

Reinforcement Learning • Updated Sep 7, 2023

datasets

None public yet