Reading List - doraithodla/notes GitHub Wiki

Dec 19

  • Petroski was the author of The Pencil: A History of Design and Circumstance, the authoritative history of the pencil.

Nov 23

Teaching Small Language Models how to Learn A Microsoft paper. The product prototype name is Orca 2. Heard a podcast about it in Seattle.

Oct 27

Oct 21

Oct 20

24th Sep - [The OpenAI API can be applied to virtually any task that requires understanding or generating natural language and code](The OpenAI API can be applied to virtually any task that requires understanding or generating natural language and code.) A Beginner's Guide to Neural Mechanisms

Articles

Books (Recommended)

Books

Blog Posts/Articles

Papers Simulation Intelligence The original "Seven Motifs" set forth a roadmap of essential methods for the field of scientific computing, where a motif is an algorithmic method that captures a pattern of computation and data movement. We present the "Nine Motifs of Simulation Intelligence", a roadmap for the development and integration of the essential algorithms necessary for a merger of scientific computing, scientific simulation, and artificial intelligence. We call this merger simulation intelligence (SI), for short. We argue the motifs of simulation intelligence are interconnected and interdependent, much like the components within the layers of an operating system. Using this metaphor, we explore the nature of each layer of the simulation intelligence operating system stack (SI-stack) and the motifs therein: (1) Multi-physics and multi-scale modeling; (2) Surrogate modeling and emulation; (3) Simulation-based inference; (4) Causal modeling and inference; (5) Agent-based modeling; (6) Probabilistic programming; (7) Differentiable programming; (8) Open-ended optimization; (9) Machine programming. We believe coordinated efforts between motifs offers immense opportunity to accelerate scientific discovery, from solving inverse problems in synthetic biology and climate science, to directing nuclear energy experiments and predicting emergent behavior in socioeconomic settings. We elaborate on each layer of the SI-stack, detailing the state-of-art methods, presenting examples to highlight challenges and opportunities, and advocating for specific ways to advance the motifs and the synergies from their combinations. Advancing and integrating these technologies can enable a robust and efficient hypothesis-simulation-analysis type of scientific method, which we introduce with several use-cases for human-machine teaming and automated science. https://arxiv.org/abs/2112.03235

Word Vector Representations: word2vec

News

-Salesforce Launches GPT for Data Insights

Listening/Watching List

What gets measured gets machine learned

From HN on how to keep current on AI.

Finished

Title: Latent Space Jun 9, 2023 From RLHF to RLHB: The Case for Learning from Human Behavior - with Jeffrey Wang and Joe Reeve of Amplitude

Latent Space

Amplitude Podcase Notes

To Read

Not all, but some https://www.scribd.com/read/662388090/Summary-Review-of-The-100-Best-Non-Fiction-Books