Reading List - doraithodla/notes GitHub Wiki
Dec 19
- Petroski was the author of The Pencil: A History of Design and Circumstance, the authoritative history of the pencil.
Nov 23
Teaching Small Language Models how to Learn A Microsoft paper. The product prototype name is Orca 2. Heard a podcast about it in Seattle.
Oct 27
- ## Naval's recommended reading
- Evolution of everything
- Fynmann - 6 easy steps -- Naval Ravikanth - The Almanac
Oct 21
- Cornel Virtual Workshop
- Applications of Vectors
- [Cornel Virtual wv
Oct 20
24th Sep - [The OpenAI API can be applied to virtually any task that requires understanding or generating natural language and code](The OpenAI API can be applied to virtually any task that requires understanding or generating natural language and code.) A Beginner's Guide to Neural Mechanisms
Articles
-
The path to detecting extraterrestrial life with astrophotonics Exoplanets, astrophotonics, integrated photonics, photonic lanterns, beam combiners, spectrographs
Books (Recommended)
- LEGO mindstorms
- Hypercard - Bill Atkinson
- ML Architecture
- The hundred page Machine Learning Book
- Start with No
- The Cold Start Problem by Andrew Chen
- Human Compatible
- The case against education
- The Mom Test
- Story Brand
- One Page Marketing
- Emyth Revisited
- Scaling People
- Build by Tony Fadell
- Disciplined Enterpreneurship by Bill Aulet
- The Enterpreneurship Equation by Carol Roth
- Turning the Flywheel by Jim Collins
- Built to Sell -Meta - Tools for finding books Blogs/Articles/Papers
Books
- Understanding Deep Learing
- Art of Probability by Hamming.
- Calculus by Spivak.
- Naive Set Theory by Halmos
- Python Natural Language Processing - Advanced Machine Learning and Deep Learning Techniques For Natural Language Processing PDF
- Hugging Face - https://huggingface.co/learn/nlp-course/chapter1/1?fw=pt
Blog Posts/Articles
- https://github.com/bentoml/OpenLLM - An open platform for operating large language models (LLMs) in production.Fine-tune, serve, deploy, and monitor any LLMs with ease.
- tps://zura.wiki/post/never-write-a-commit-message-again-with-the-help-of-gpt-3/
- #The Rise of the Millionaire LinkedIn Influencer - https://www.vice.com/en/article/4ax5wp/the-rise-of-the-millionaire-linkedin-influencer
Papers Simulation Intelligence The original "Seven Motifs" set forth a roadmap of essential methods for the field of scientific computing, where a motif is an algorithmic method that captures a pattern of computation and data movement. We present the "Nine Motifs of Simulation Intelligence", a roadmap for the development and integration of the essential algorithms necessary for a merger of scientific computing, scientific simulation, and artificial intelligence. We call this merger simulation intelligence (SI), for short. We argue the motifs of simulation intelligence are interconnected and interdependent, much like the components within the layers of an operating system. Using this metaphor, we explore the nature of each layer of the simulation intelligence operating system stack (SI-stack) and the motifs therein: (1) Multi-physics and multi-scale modeling; (2) Surrogate modeling and emulation; (3) Simulation-based inference; (4) Causal modeling and inference; (5) Agent-based modeling; (6) Probabilistic programming; (7) Differentiable programming; (8) Open-ended optimization; (9) Machine programming. We believe coordinated efforts between motifs offers immense opportunity to accelerate scientific discovery, from solving inverse problems in synthetic biology and climate science, to directing nuclear energy experiments and predicting emergent behavior in socioeconomic settings. We elaborate on each layer of the SI-stack, detailing the state-of-art methods, presenting examples to highlight challenges and opportunities, and advocating for specific ways to advance the motifs and the synergies from their combinations. Advancing and integrating these technologies can enable a robust and efficient hypothesis-simulation-analysis type of scientific method, which we introduce with several use-cases for human-machine teaming and automated science. https://arxiv.org/abs/2112.03235
-
Ben Gilad's 'Early Warning' book
-
From word models to World Models - https://arxiv.org/pdf/2306.12672.pdf?fname=cm&font=TypeI
-
Videos
-
The theory of computation # Cotnext Free Gramma
Word Vector Representations: word2vec
- Cal-QL: Calibrated Oline RL Pre-Training for Efficient Fine Tuning
- NLP Models from RNN to Transformer5
- T5 Transformer
- Attention is all you need
- 100K context windows
- GPT4 can't ace MIT
- Introducing 100K context windows
- Fast Transformer Decoding https://github.com/daveshap/NaturalLanguageCognitiveArchitecture https://oli.cmu.edu/courses/visual-design-open-free/ https://blog.ioces.com/matt/posts/everything-old-is-new-again/ https://docs.google.com/document/d/1o-R0BEAIl2qTcQS60lZSqHAnEUwgx9CFKf7pAIVHcVQ/edit# https://read.amazon.com/?asin=B00AG66LTM&ref_=kwl_kr_iv_rec_1&language=en-US https://www.anaconda.com/blog/pyscript-python-in-the-browser
News
-Salesforce Launches GPT for Data Insights
Listening/Watching List
What gets measured gets machine learned
From HN on how to keep current on AI.
- https://news.ycombinator.com/fave?id=35479853&auth=a194f6ee6cbf108c29a8b04d79ab465f848c967d
- https://news.ycombinator.com/vote?id=35480816&how=up&auth=9bbd683fc87d11a488e728546eae6e7ef4eff2cc&goto=item%3Fid%3D35479853#35480816
- https://news.ycombinator.com/user?id=pmoriarty
- https://news.ycombinator.com/item?id=35480816
- https://news.ycombinator.com/item?id=35479853#35480813
- https://www.reddit.com/r/ChatGPT/comments/12diapw/gpt4_week_3_chatbots_are_yesterdays_news_ai/
- https://news.ycombinator.com/reply?id=35480816&goto=item%3Fid%3D35479853%2335480816
- https://news.ycombinator.com/vote?id=35480813&how=up&auth=cea9255d2f73fef13fa0b4c22e0f394a621db104&goto=item%3Fid%3D35479853#35480813
- https://news.ycombinator.com/user?id=adt
- https://news.ycombinator.com/item?id=35480813
- https://news.ycombinator.com/item?id=35479853#35480816
- https://news.ycombinator.com/item?id=35479853#35480384
- https://lifearchitect.ai/memo/
- https://news.ycombinator.com/reply?id=35480813&goto=item%3Fid%3D35479853%2335480813
- https://news.ycombinator.com/vote?id=35480384&how=up&auth=2166eb48c43f15fd501ac585db775cb2ff75bd0a&goto=item%3Fid%3D35479853#35480384
- https://news.ycombinator.com/user?id=AdrienBrault
- https://news.ycombinator.com/item?id=35480384
- https://news.ycombinator.com/item?id=35479853#35480610
- https://simonwillison.net/
- https://simonw.substack.com/
- https://news.ycombinator.com/reply?id=35480384&goto=item%3Fid%3D35479853%2335480384
- https://news.ycombinator.com/vote?id=35480610&how=up&auth=59a6cdb827034e871c599dd55847aafbe2ec965e&goto=item%3Fid%3D35479853#35480610
- https://news.ycombinator.com/user?id=d4rkp4ttern
- https://news.ycombinator.com/item?id=35480610
- https://news.ycombinator.com/item?id=35479853#35480208
- https://news.ycombinator.com/reply?id=35480610&goto=item%3Fid%3D35479853%2335480610
- https://news.ycombinator.com/vote?id=35480643&how=up&auth=e3a40e9b5c291724c8ad8146fb13073eb5596604&goto=item%3Fid%3D35479853#35480643
- https://news.ycombinator.com/user?id=Veen
- https://news.ycombinator.com/item?id=35480643
- https://feedbin.com/blog/2023/03/30/twitter-access-revoked/
- https://news.ycombinator.com/reply?id=35480643&goto=item%3Fid%3D35479853%2335480643
- https://news.ycombinator.com/vote?id=35480830&how=up&auth=24149181c10a5ccdda2c6d9d53cf7a2a13e00231&goto=item%3Fid%3D35479853#35480830
- https://news.ycombinator.com/user?id=ipaddr
- https://news.ycombinator.com/item?id=35480830
- https://news.ycombinator.com/item?id=35479853#35480643
- https://news.ycombinator.com/reply?id=35480830&goto=item%3Fid%3D35479853%2335480830
- https://news.ycombinator.com/vote?id=35480208&how=up&auth=ba9376461d98eec9f87f0a52490aba3e821c8b77&goto=item%3Fid%3D35479853#35480208
- https://news.ycombinator.com/user?id=ulrikhansen54
- https://news.ycombinator.com/item?id=35480208
- https://news.ycombinator.com/item?id=35479853#35480683
- https://paperswithcode.com/
- https://news.ycombinator.com/reply?id=35480208&goto=item%3Fid%3D35479853%2335480208
- https://news.ycombinator.com/vote?id=35480674&how=up&auth=2948d291c7b1c5968277a14f4f3e21ff9a4289ac&goto=item%3Fid%3D35479853#35480674
- https://news.ycombinator.com/item?id=35480674
- https://news.ycombinator.com/item?id=35479853#35480553
- https://news.ycombinator.com/reply?id=35480674&goto=item%3Fid%3D35479853%2335480674
- https://news.ycombinator.com/vote?id=35480553&how=up&auth=0265cfb346e8b41347938eeb2d9ab88af4ffc6a1&goto=item%3Fid%3D35479853#35480553
- https://news.ycombinator.com/user?id=Jaxan
- https://news.ycombinator.com/item?id=35480553
- https://news.ycombinator.com/item?id=35479853#35480674
- https://news.ycombinator.com/item?id=35479853#35480312
- https://news.ycombinator.com/reply?id=35480553&goto=item%3Fid%3D35479853%2335480553
- https://news.ycombinator.com/vote?id=35480599&how=up&auth=27e0f3e3ac06db59cef3885ee60cb1e78c811db5&goto=item%3Fid%3D35479853#35480599
- https://news.ycombinator.com/user?id=danesparza
- https://news.ycombinator.com/item?id=35480599
- https://news.ycombinator.com/item?id=35479853#35480595
- https://news.ycombinator.com/reply?id=35480599&goto=item%3Fid%3D35479853%2335480599
- https://news.ycombinator.com/vote?id=35480595&how=up&auth=df2ea2c369bdab56dd9c2edfe1ff891d2a6330eb&goto=item%3Fid%3D35479853#35480595
- https://news.ycombinator.com/user?id=polynomial
- https://news.ycombinator.com/item?id=35480595
- https://news.ycombinator.com/item?id=35479853#35480599
- https://news.ycombinator.com/reply?id=35480595&goto=item%3Fid%3D35479853%2335480595
- https://news.ycombinator.com/vote?id=35480312&how=up&auth=8e3e124ba8087578c0d98d0817eed139f3bbdd54&goto=item%3Fid%3D35479853#35480312
- https://news.ycombinator.com/user?id=auggierose
- https://news.ycombinator.com/item?id=35480312
- https://news.ycombinator.com/reply?id=35480312&goto=item%3Fid%3D35479853%2335480312
- https://news.ycombinator.com/vote?id=35480379&how=up&auth=03a3abd9be6f2eec91193086f472c92b883add48&goto=item%3Fid%3D35479853#35480379
- https://news.ycombinator.com/item?id=35480379
- https://news.ycombinator.com/reply?id=35480379&goto=item%3Fid%3D35479853%2335480379
- https://news.ycombinator.com/vote?id=35480683&how=up&auth=09c6aba789ec490a164559b3115209276ab09958&goto=item%3Fid%3D35479853#35480683
- https://news.ycombinator.com/user?id=zulban
- https://news.ycombinator.com/item?id=35480683
- https://news.ycombinator.com/item?id=35479853#35480691
- https://news.ycombinator.com/reply?id=35480683&goto=item%3Fid%3D35479853%2335480683
- https://news.ycombinator.com/vote?id=35480691&how=up&auth=b49808d02534e688fe35df480ad67af4f5938a39&goto=item%3Fid%3D35479853#35480691
- https://news.ycombinator.com/user?id=edouard-harris
- https://news.ycombinator.com/item?id=35480691
- https://news.ycombinator.com/item?id=35479853#35480692
- https://www.aitracker.org/
- https://news.ycombinator.com/reply?id=35480691&goto=item%3Fid%3D35479853%2335480691
- https://news.ycombinator.com/vote?id=35480692&how=up&auth=6a991abe5ed4a1b67cb7455e19edd53727bccfed&goto=item%3Fid%3D35479853#35480692
- https://news.ycombinator.com/user?id=anonzzzies
- https://news.ycombinator.com/item?id=35480692
- https://news.ycombinator.com/item?id=35479853#35480397
- https://news.ycombinator.com/reply?id=35480692&goto=item%3Fid%3D35479853%2335480692
- https://news.ycombinator.com/vote?id=35480397&how=up&auth=6edf11b389238e7c8d6e9bf976e36df7aa3c090b&goto=item%3Fid%3D35479853#35480397
- https://news.ycombinator.com/user?id=A_D_E_P_T
- https://news.ycombinator.com/item?id=35480397
- https://news.ycombinator.com/item?id=35479853#35480717
- https://thezvi.wordpress.com/2023/04/06/ai-6-agents-of-change/
- https://news.ycombinator.com/reply?id=35480397&goto=item%3Fid%3D35479853%2335480397
- https://news.ycombinator.com/vote?id=35480549&how=up&auth=14b7a88a841c515e163208bf46d1f7425d0bf332&goto=item%3Fid%3D35479853#35480549
- https://news.ycombinator.com/user?id=fock
- https://news.ycombinator.com/item?id=35480549
- https://news.ycombinator.com/item?id=35479853#35480543
- https://news.ycombinator.com/reply?id=35480549&goto=item%3Fid%3D35479853%2335480549
- https://news.ycombinator.com/vote?id=35480543&how=up&auth=bb41c8ffd6e1ec0e777d3cb8439c3920951ee041&goto=item%3Fid%3D35479853#35480543
- https://news.ycombinator.com/user?id=quaintdev
- https://news.ycombinator.com/item?id=35480543
- https://news.ycombinator.com/item?id=35479853#35480549
- https://news.ycombinator.com/reply?id=35480543&goto=item%3Fid%3D35479853%2335480543
- https://news.ycombinator.com/vote?id=35480588&how=up&auth=bec36ef69f5bdee3068aeab0b80bbce04a819e14&goto=item%3Fid%3D35479853#35480588
- https://news.ycombinator.com/user?id=input_sh
- https://news.ycombinator.com/item?id=35480588
- https://news.ycombinator.com/reply?id=35480588&goto=item%3Fid%3D35479853%2335480588
- https://news.ycombinator.com/vote?id=35480717&how=up&auth=6b45b00e9b2613a0d168effeb18482933bab900d&goto=item%3Fid%3D35479853#35480717
- https://news.ycombinator.com/user?id=benrapscallion
- https://news.ycombinator.com/item?id=35480717
- https://news.ycombinator.com/item?id=35479853#35480252
- https://syncedreview.com/
- https://news.ycombinator.com/reply?id=35480717&goto=item%3Fid%3D35479853%2335480717
- https://news.ycombinator.com/vote?id=35480252&how=up&auth=fee86da745ef351f52574a4d6123be528aa97b77&goto=item%3Fid%3D35479853#35480252
- https://news.ycombinator.com/user?id=agomez314
- https://news.ycombinator.com/item?id=35480252
- https://news.ycombinator.com/item?id=35479853#35480267
- https://www.theneurondaily.com/
- https://news.ycombinator.com/reply?id=35480252&goto=item%3Fid%3D35479853%2335480252
- https://news.ycombinator.com/vote?id=35480267&how=up&auth=b47ef6e3332e1f18580d014b5326afd878637b2a&goto=item%3Fid%3D35479853#35480267
- https://news.ycombinator.com/user?id=poulpy123
- https://news.ycombinator.com/item?id=35480267
- https://news.ycombinator.com/item?id=35479853#35480308
- https://news.ycombinator.com/reply?id=35480267&goto=item%3Fid%3D35479853%2335480267
- https://news.ycombinator.com/vote?id=35480326&how=up&auth=81ecf0df558e43299893caf796ecfc5ea0796d70&goto=item%3Fid%3D35479853#35480326
- https://news.ycombinator.com/user?id=tomduncalf
- https://news.ycombinator.com/item?id=35480326
- https://news.ycombinator.com/item?id=35479853#35480658
- https://karpathy.ai/zero-to-hero.html
- https://news.ycombinator.com/reply?id=35480326&goto=item%3Fid%3D35479853%2335480326
- https://news.ycombinator.com/vote?id=35480658&how=up&auth=2395ce9950c7035a7a57cad8b469833fdb697c43&goto=item%3Fid%3D35479853#35480658
- https://news.ycombinator.com/user?id=tommiegannert
- https://news.ycombinator.com/item?id=35480658
- https://news.ycombinator.com/item?id=35479853#35480326
- https://news.ycombinator.com/item?id=35479853#35480323
- https://gist.github.com/rain-1/eebd5e5eb2784feecf450324e3341c8d
- https://news.ycombinator.com/reply?id=35480658&goto=item%3Fid%3D35479853%2335480658
- https://news.ycombinator.com/vote?id=35480323&how=up&auth=d0c91aa8791b7e61797454626d0078899c5cc0d3&goto=item%3Fid%3D35479853#35480323
- https://news.ycombinator.com/user?id=Zealotux
- https://news.ycombinator.com/item?id=35480323
- https://news.ycombinator.com/item?id=35479853#35480368
- https://www.youtube.com/watch?v=kCc8FmEb1nY
- https://news.ycombinator.com/reply?id=35480323&goto=item%3Fid%3D35479853%2335480323
- https://news.ycombinator.com/vote?id=35480368&how=up&auth=a2f03cad6f01fb90146a0222b5221db8402a2d7e&goto=item%3Fid%3D35479853#35480368
- https://news.ycombinator.com/user?id=Al0neStar
- https://news.ycombinator.com/item?id=35480368
- https://news.ycombinator.com/item?id=35479853#35480324
- https://bayesnet.org/books/
- https://news.ycombinator.com/reply?id=35480368&goto=item%3Fid%3D35479853%2335480368
- https://news.ycombinator.com/vote?id=35480324&how=up&auth=dd10420c06f625091d591ace7e1f0c85c9975cc4&goto=item%3Fid%3D35479853#35480324
- https://news.ycombinator.com/item?id=35480324
- https://news.ycombinator.com/item?id=35479853#35480680
- https://course.fast.ai/
- https://news.ycombinator.com/reply?id=35480324&goto=item%3Fid%3D35479853%2335480324
- https://news.ycombinator.com/vote?id=35480680&how=up&auth=7e5e8032b03be732369216633c5aaa7b623ac78b&goto=item%3Fid%3D35479853#35480680
- https://news.ycombinator.com/user?id=lysecret
- https://news.ycombinator.com/item?id=35480680
- https://news.ycombinator.com/item?id=35479853#35480511
- https://news.ycombinator.com/reply?id=35480680&goto=item%3Fid%3D35479853%2335480680
- https://news.ycombinator.com/vote?id=35480511&how=up&auth=1d181f3dd03242177602463b2159ec9958660b1c&goto=item%3Fid%3D35479853#35480511
- https://news.ycombinator.com/user?id=ngc248
- https://news.ycombinator.com/item?id=35480511
- https://www.youtube.com/playlist?list=PLTPQEx-31JXgtDaC6-3HxWcp7fq4N8YGr
- https://news.ycombinator.com/reply?id=35480511&goto=item%3Fid%3D35479853%2335480511
- https://news.ycombinator.com/vote?id=35480308&how=up&auth=d276ad15e8301aa2ab7ad51ff1565840eb69275d&goto=item%3Fid%3D35479853#35480308
- https://news.ycombinator.com/user?id=aldarisbm
- https://news.ycombinator.com/item?id=35480308
- https://news.ycombinator.com/item?id=35479853#35480373
- https://www.emergentmind.com/
- https://news.ycombinator.com/reply?id=35480308&goto=item%3Fid%3D35479853%2335480308
- https://news.ycombinator.com/vote?id=35480373&how=up&auth=d79b7619c4b43efea079d0a92dd6140db3c4e40a&goto=item%3Fid%3D35479853#35480373
- https://news.ycombinator.com/user?id=ReDeiPirati
- https://news.ycombinator.com/item?id=35480373
- https://news.ycombinator.com/item?id=35479853#35480279
- https://news.ycombinator.com/reply?id=35480373&goto=item%3Fid%3D35479853%2335480373
- https://news.ycombinator.com/vote?id=35480825&how=up&auth=79d62d5795f90289dc7591121ac7483c9a59c369&goto=item%3Fid%3D35479853#35480825
- https://news.ycombinator.com/user?id=gronky_
- https://news.ycombinator.com/item?id=35480825
- https://news.ycombinator.com/reply?id=35480825&goto=item%3Fid%3D35479853%2335480825
- https://news.ycombinator.com/vote?id=35480279&how=up&auth=96713c04e7ce7a0fa272ccfebfc04ead0362bf90&goto=item%3Fid%3D35479853#35480279
- https://news.ycombinator.com/user?id=ksplicer
- https://news.ycombinator.com/item?id=35480279
- https://news.ycombinator.com/item?id=35479853#35480321
- https://papers.labml.ai/
- https://news.ycombinator.com/reply?id=35480279&goto=item%3Fid%3D35479853%2335480279
- https://news.ycombinator.com/vote?id=35480321&how=up&auth=22acdb8ae806d24f88ae6b6f50889ca7ba52f8ae&goto=item%3Fid%3D35479853#35480321
- https://news.ycombinator.com/user?id=ubj
- https://news.ycombinator.com/item?id=35480321
- https://news.ycombinator.com/item?id=35479853#35480552
- https://tldr.tech/ai
- https://news.ycombinator.com/reply?id=35480321&goto=item%3Fid%3D35479853%2335480321
- https://news.ycombinator.com/vote?id=35480552&how=up&auth=79fad124f4eb157f13cc7da19f3968270ca1ed47&goto=item%3Fid%3D35479853#35480552
- https://news.ycombinator.com/user?id=artemonster
- https://news.ycombinator.com/item?id=35480552
- https://news.ycombinator.com/reply?id=35480552&goto=item%3Fid%3D35479853%2335480552
- https://news.ycombinator.com/vote?id=35480788&how=up&auth=7a93c9260d638390f53f5912f2eb043c0f4ffdba&goto=item%3Fid%3D35479853#35480788
- https://news.ycombinator.com/item?id=35480788
- https://news.ycombinator.com/item?id=35479853#35480590
- https://news.ycombinator.com/reply?id=35480788&goto=item%3Fid%3D35479853%2335480788
- https://news.ycombinator.com/vote?id=35480590&how=up&auth=515e999fff0f22bc717ac7fbbe32b2effb2f8fe6&goto=item%3Fid%3D35479853#35480590
- https://news.ycombinator.com/user?id=ryanwaggoner
- https://news.ycombinator.com/item?id=35480590
- https://news.ycombinator.com/item?id=35479853#35480788
- https://news.ycombinator.com/reply?id=35480590&goto=item%3Fid%3D35479853%2335480590
- https://www.ycombinator.com/apply/
Finished
Title: Latent Space Jun 9, 2023 From RLHF to RLHB: The Case for Learning from Human Behavior - with Jeffrey Wang and Joe Reeve of Amplitude
To Read
Not all, but some https://www.scribd.com/read/662388090/Summary-Review-of-The-100-Best-Non-Fiction-Books