-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathindex.html
342 lines (324 loc) · 16.2 KB
/
index.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
<!doctype html>
<html lang="en">
<head>
<meta charset="UTF-8" />
<meta name="viewport" content="width=device-width, initial-scale=1" />
<link rel="shortcut icon" href="/favicon.ico" />
<title>ravens' site</title>
<link rel="stylesheet" href="style.css" />
</head>
<body>
<div class="header">rvns.moe</div>
<div class="box" data-label="about me">
<p>
hello, I'm ravens. I'm a "sr staff" software "engineer" for a bigco.
I lead a team of ~30 product engineers, and help run an org of ~350.
</p>
<p>I do a lot of other random stuff on the side.</p>
<p>
you can find me here:
<ul>
<li>
<a href="https://twitter.com/_R4V3N5_" target="_blank"
>@_R4V3N5_ on twitter</a
>
</li>
<li>
<a href="https://github.com/ravens2d" target="_blank"
>ravens2d on github</a
>
</li>
<li>
<a href="https://bsky.app/profile/rvns.moe" target="_blank"
>@rvns.moe on bluesky</a
>
</li>
</ul>
</p>
</div>
<div class="box" data-label="posts">
<p class="small-text">no posts yet..</p>
</div>
<div class="box" data-label="projects">
<p>here are some projects I'm working on:</p>
<p>
<a href="https://github.com/ravens2d/kawavm" target="_blank">kawa</a>
- a fantasy retro console virtual machine, using a stack machine
architecture with 16 bit words, 64k mem, 16k roms, and memory mapped
IO
</p>
<p>
<a href="/posts/yuzu" target="_blank">yuzu</a> - a peer to peer chat
protocol with permissionless network participation, global
discovery, and pseudo-finality
</p>
<p>
<a href="https://github.com/ravens2d/ivy" target="_blank">ivy</a> -
a local first, p2p runtime using mDNS+DNS-SD for local network peer
discovery, CBOR for serialization, ed25519 for peer identity, and a
hand rolled diffie-hellman exchange for handshakes/wire encryption
</p>
<p>
<a href="https://github.com/ravens2d/yui" target="_blank">yui</a>
- my personal claude in my terminal. supports episodic and factual memory.
experimentation ground for other more fringe agentic features.
</p>
</div>
<div class="box" data-label="blogroll">
<p>others you should check out, in no particular order:</p>
<ul>
<li>
<a href="https://kennethnym.com/" target="_blank">kennethnym</a>
</li>
<li>
<a href="https://hitorilabs.com/" target="_blank">hitorilabs</a>
</li>
<li><a href="https://vmfunc.re/" target="_blank">vmfunc</a></li>
<li><a href="https://esp.ac/" target="_blank">esp</a></li>
<li>
<a href="https://www.catgirl.ing/" target="_blank">rose</a>
</li>
<li><a href="https://qtnx.ai/" target="_blank">qtnx</a></li>
<li>
<a href="https://near.blog/" target="_blank">nearcyan</a>
</li>
<li><a href="https://vin.gg/" target="_blank">vin</a></li>
<li>
<a href="https://echo4eva.com/" target="_blank">echo4eva</a>
</li>
<li>
<a href="https://felixkunze.xyz/" target="_blank">xilo</a>
</li>
<li>
<a href="https://dcpunks.computer/" target="_blank">dcpunks</a>
</li>
<li>
<a href="https://a11ce.com/" target="_blank">a11ce</a>
</li>
</ul>
</div>
<h1>reading list</h1>
<div class="box" data-label="to read">
<ul>
<li>
<a href="https://arxiv.org/pdf/2411.18674" target="_blank">Active Data Curation Effectively Distills Large-Scale Multimodal Models</a>
</li>
<li>
<a href="https://arxiv.org/abs/2405.14333" target="_blank">DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data</a>
</li>
<li>
<a href="https://arxiv.org/abs/2207.00032" target="_blank">DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale</a>
</li>
<li>
<a href="https://arxiv.org/pdf/1811.06965" target="_blank">GPipe: Easy Scaling with Micro-Batch Pipeline
Parallelism</a>
</li>
<li>
<a href="https://arxiv.org/abs/2309.06180" target="_blank">Efficient Memory Management for Large Language Model Serving with PagedAttention</a>
</li>
<li>
<a href="https://arxiv.org/abs/2407.13692" target="_blank">Prover-Verifier Games improve legibility of LLM outputs</a>
</li>
</ul>
</div>
<div class="box" data-label="currently reading">
<ul>
<li>
<a href="https://arxiv.org/abs/2201.12023" target="_blank">Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning</a>
</li>
</ul>
</div>
<div class="box" data-label="backburner">
<ul>
<li>
<a href="https://learnyouahaskell.github.io/chapters.html" target="_blank">Learn You a Haskell for Great Good!</a>
</li>
<li>
<a href="https://github.com/hmemcpy/milewski-ctfp-pdf" target="_blank">Category Theory For Programmers</a>
</li>
<li>
<a href="https://docs.google.com/document/d/e/2PACX-1vQD8IlBotGdBxp3BnXkSjk8bNZlPV_0EH9ZA6wHd5dNf-BLSiwXUinvgv8ZoBEnNyTCF-chWO30NRw0/pub" target="_blank">Keeping up with AGI (Google Doc)
</a>
</li>
<li>
<a href="https://lilianweng.github.io/posts/2018-02-19-rl-overview" target="_blank">A (Long) Peek into Reinforcement Learning</a>
</li>
</ul>
</div>
<div class="box" data-label="read, want to remember">
<ul>
<li>
<a href="https://planetbanatt.net/articles/mla.html" target="_blank">Understanding Multi-Head Latent Attention</a>
</li>
<li>
<a href="https://yugeten.github.io/posts/2025/01/ppogrpo/" target="_blank">A vision researcher's guide to some RL stuff: PPO & GRPO</a>
</li>
<li>
<a href="https://huggingface.co/blog/designing-positional-encoding" target="_blank">You could have designed state of the art positional encoding</a>
</li>
<li>
<a href="https://jax-ml.github.io/scaling-book/" target="_blank">How to Scale Your Model - A Systems View of LLMs on TPUs</a>
</li>
<li>
<a href="https://aman.ai/primers/ai/deepseek-R1/#mixture-of-experts-moe" target="_blank">Mixture of Experts (MoE) - Deepseek-R1 Primer</a>
</li>
<li>
<a href="https://nn.labml.ai/transformers/mha.html" target="_blank">Multi-Headed Attention (MHA)</a>
</li>
<li>
<a href="https://arxiv.org/abs/2402.03300" target="_blank">DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models</a>
</li>
<li>
<a href="https://arxiv.org/pdf/2212.13567.pdf" target="_blank">Range-Based Set Reconciliation and Authenticated Set
Representations</a>
</li>
<li>
<a href="https://gsd.di.uminho.pt/members/jop/pdfs/LPR07a.pdf" target="_blank">Epidemic Broadcast Trees</a>
</li>
<li>
<a href="https://arxiv.org/abs/2312.08365" target="_blank">An Invitation to Deep Reinforcement Learning</a>
</li>
<li>
<a href="https://arxiv.org/pdf/2006.15704" target="_blank">PyTorch Distributed: Experiences on Accelerating Data Parallel Training</a>
</li>
<li>
<a href="https://www.usenix.org/system/files/conference/osdi14/osdi14-paper-li_mu.pdf" target="_blank">Scaling Distributed Machine Learning
with the Parameter Server</a>
</li>
<li>
<a href="https://arxiv.org/pdf/1603.01529" target="_blank">Delta State Replicated Data Types</a>
</li>
<li>
<a href="https://www.cs.princeton.edu/~mfreed/docs/coral-iptps03.pdf" target="_blank">Sloppy hashing and self-organizing clusters (Coral
Paper)</a>
</li>
<li>
<a href="https://research.vmware.com/files/attachments/0/0/0/0/0/7/7/podc.pdf" target="_blank">HotStuff: BFT Consensus with Linearity and
Responsiveness</a>
</li>
<li>
<a href="https://github.com/cabal-club/cable" target="_blank">Cable Protocol</a>
</li>
<li>
<a href="https://hal.inria.fr/hal-02303490/document" target="_blank">Merkle Search Trees: Efficient State-Based CRDTs in Open
Networks</a>
</li>
<li>
<a href="https://willowprotocol.org/" target="_blank">The Willow Protocol</a>
</li>
<li>
<a href="https://www.databass.dev/" target="_blank">Database Internals: A Deep Dive into How Distributed Data
Systems Work</a>
</li>
<li>
<a href="https://arxiv.org/abs/2402.14083" target="_blank">Beyond A*: Better Planning with Transformers via Search
Dynamics Bootstrapping</a>
</li>
<li>
<a href="https://raft.github.io/raft.pdf">In Search of an Understandable Consensus Algorithm (The
RAFT Paper)</a>
</li>
<li>
<a href="https://docs.google.com/document/d/1tBw9A4j62ruI5omIJbMxly-la5w4q_TjyJgJL_jN2fI/edit#heading=h.iyrm5j2gcdoq" target="_blank">Ray v2 Architecture</a>
</li>
<li>
<a href="https://mattweidner.com/2022/02/10/collaborative-data-design.html" target="_blank">Designing Data Structures for Collaborative Apps
</a>
</li>
<li>
<a href="https://grugbrain.dev/" target="_blank">The Grug Brained Developer - A layman's guide to thinking
like the self-aware smol brained</a>
</li>
<li>
<a href="https://crdt.tech/implementations" target="_blank">General-purpose CRDT libraries
</a>
</li>
<li>
<a href="https://automerge.org/" target="_blank">Automerge Libarary</a>
</li>
<li>
<a href="https://applied-langua.ge/software-and-anarchy.pdf" target="_blank">Software and Anarchy</a>
</li>
<li>
<a href="http://docs.peachcloud.org/introduction.html" target="_blank">Peachcloud docs</a>
</li>
<li>
<a href="https://amaarora.github.io/posts/2020-02-18-annotatedGPT2.html" target="_blank">The Annotated GPT-2</a>
</li>
<li>
<a href="https://habr.com/en/company/ods/blog/708672/" target="_blank">Building a GPT-like Model from Scratch with Detailed Theory
and Code Implementation</a>
</li>
<li>
<a href="https://arxiv.org/pdf/2210.11416.pdf" target="_blank">Scaling Instruction-Finetuned Language Models</a>
</li>
<li>
<a href="http://nlp.seas.harvard.edu/annotated-transformer/" target="_blank">The Annotated Transformer</a>
</li>
<li>
<a href="https://blogs.newardassociates.com/blog/2023/you-want-modules-not-microservices.html" target="_blank">You Want Modules, Not Microservices
</a>
</li>
<li>
<a href="https://deno.land/x/earthstar@v10.0.0/mod.ts" target="_blank">Earthstar docs</a>
</li>
<li>
<a href="https://martin.kleppmann.com/papers/bft-crdt-papoc22.pdf" target="_blank">Making CRDTs Byzantine Fault Tolerant</a>
</li>
<li>
<a href="https://gitlab.com/cal-coop/netfarm/netfarm" target="_blank">netfarm source code</a>
/
<a href="https://cal-coop.gitlab.io/netfarm/documentation/Introduction.html" target="_blank">Netfarm Introduction</a>
</li>
<li>
<a href="https://p2panda.org/learn" target="_blank">p2panda docs</a>
</li>
<li>
<a href="https://applied-langua.ge/posts/here-is-a-loud-announcement.html" target="_blank">Applied Language announces Applied Language</a>
</li>
<li>
<a href="https://www.hyperhyperspace.org/whitepaper/" target="_blank">Hyperhyperspace whitepaper</a>
</li>
<li>
<a href="https://www.inkandswitch.com/local-first/" target="_blank">Local-first software</a>
</li>
<li>
<a href="https://earthstar-project.org/get-started/how-it-works" target="_blank">How Earthstar Works</a>
</li>
<li>
<a href="https://ssbc.github.io/scuttlebutt-protocol-guide/" target="_blank">Scuttlebutt protocol guide</a>
</li>
<li>
<a href="https://socialhub.activitypub.rocks/pub/guide-for-new-activitypub-implementers" target="_blank">Guide for new activitypub implementers</a>
</li>
<li>
<a href="https://cabal.chat/" target="_blank">cabal protocol</a>
</li>
<li>
<a href="https://www.w3.org/TR/did-core/" target="_blank">DID Spec</a>
</li>
<li>
<a href="https://github.com/christianlundkvist/rebooting-the-web-of-trust" target="_blank">Rebooting the Web of Trust</a>
</li>
<li>
<a href="https://github.com/WebOfTrustInfo" target="_blank">Web of Trust</a>
</li>
<li>
<a href="https://orbitdb.org/" target="_blank">OrbitDB Docs</a>
</li>
<li>
<a href="https://gun.eco/" target="_blank">GunDB Docs</a>
</li>
<li>
<a href="https://pdos.csail.mit.edu/~petar/papers/maymounkov-kademlia-lncs.pdf" target="_blank">The Kademlia paper</a>
</li>
<li>
<a href="https://hypercore-protocol.org/" target="_blank">Hypercore Protocol</a>
</li>
</ul>
</div>
<div class="meta">
UPDATED: 2024-12-19 | THANK YOU FOR YOUR VISIT <3
</div>
</body>
</html>