Research Library
Library
Papers, patents & whitepapers, annotated
Processing sequences using convolutional neural networks
DeepMind Technologies Ltd · USPTO — US11080591B2 · 2021
The convolutional answer to sequence modelling, filed as the transformer was arriving. A good illustration that the architecture that wins is not the only one that worked.
Multi-task learning using knowledge distillation
Google LLC · USPTO — US10635977B2 · 2020
Distillation as claimed intellectual property, and the technique behind nearly every small model that punches above its size — including several on this shelf. Read it next to the on-policy distillation work here to see how far the idea has since travelled.
Attention-based sequence transduction neural networks
Google LLC · USPTO — US10452978B2 · 2019
The Transformer, as a granted patent. Useful for seeing how a landmark architecture is framed in IP terms — and a reminder that the research and the patent often diverge.
System and method for addressing overfitting in a neural network
Google LLC · USPTO — US9406017B2 · 2016
Dropout, patented. Worth a look because it is one of the clearest cases of a technique that spread through the field as a free idea while also existing as an enforceable claim.
Computing numeric representations of words in a high-dimensional space
Google LLC · USPTO — US9037464B1 · 2015
The word-embedding idea as granted intellectual property. Useful for seeing how a technique that became foundational infrastructure was framed in claim language — and a reminder that the paper and the patent are separate artefacts with different purposes.
Showing 1–5 of 5 sources · newest first
About Nybble™
The AI space moves fast.
Nybble™ is how you keep up — and stay sharp.
What happened. In two minutes.
The AI news cycle moves at a pace no one can keep up with. Snack distills what launched, what shipped, and what matters — every day, without the filler.
Go to SnackThe concepts behind the headlines.
News tells you what. Stack tells you why and how. From RAG architectures to agentic evals, these are the ideas that will shape what you build next.
Go to StackProve you actually get it.
Reading about LangChain is not the same as knowing it. Hack challenges you with production-grade questions, then shows you the references that make the answer stick.
Go to Hack