furst/ssearch
0
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Initial commit: RAG pipeline for semantic search over personal journal archive

Browse source 
Vector search with cross-encoder re-ranking, hybrid BM25+vector retrieval,
incremental index updates, and multiple LLM backends (Ollama local, OpenAI API).
This commit is contained in:
Eric 2026-02-20 06:02:28 -05:00
commit e9fc99ddc6
43 changed files with 7349 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

52
saved_output/2025_08_24.txt Normal file
View file

@ -0,0 +1,52 @@
Enter a search topic or question (or 'exit'):
The mind as a terrible master.
**Summary Theme:**
This collection of excerpts explores the human mind's complex nature, its cognitive processes, perception, memory, and social
interactions. The texts delve into how our thoughts are shaped by external stimuli, our brain's organizational patterns, and the
emergence of consciousness. Additionally, they touch on the mind's tendency to create illusions (like "mass delusion") and the
challenges posed by a distributed brain and decentralized consciousness.
**Matching Files:**
1. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2023-01-23.txt - The excerpt examines what becomes of an
incessant critic in the mind, questioning the role of brain functions in creating negative self-perceptions.
2. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-03-10.txt - The excerpt delves into the journal's
effect on cognition, implying that it can profoundly influence thought processes even if not actively processing itself.
3. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-08-18.txt - This excerpt suggests a comparison between
a mind that is constantly on the move and an overloaded train, emphasizing the lack of central control.
4. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-03-08.txt - The excerpt explores thoughts as
"tendrils" that can hold a person and influence their mood and behavior, mirroring the mind's struggle with self-awareness.
5. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2019-07-03.txt - This excerpt connects the idea of
"impression management" to evolutionary adaptation, suggesting a mind capable of organizing individuals around "fictions."
6. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-03-24.txt - The excerpt emphasizes the modularity of
the mind and preconditioned responses, reflecting on E. Bruce Goldstein's book and its relevance to understanding consciousness.
7. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2023-01-06.txt - A contemplation of memory's role as a
"lump of coal that bears the delicate impression of a leaf," highlighting its complexity and non-linear nature.
8. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2021-05-04.txt - The excerpt reflects on feelings of
skepticism about human endeavors and the mind's tendency to imagine conflict, leading to negative self-judgment.
9. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2023-01-23.txt - The excerpt references David Foster
Wallace's quote about the mind as a "terrible master" and explores how individuals who commit suicide often shoot themselves in the
head, silencing their inner critic.
10. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-03-08.txt - This excerpt discusses the philosophical
implications of a distributed brain and decentralized consciousness, questioning the existence of a singular "self" making
decisions.
Source documents:
2009-08-24.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2009-08-24.txt 0.7286187534682154
2023-01-23.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2023-01-23.txt 0.7174705749042735
2023-03-09.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2023-03-09.txt 0.6905817844827031
2023-01-06.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2023-01-06.txt 0.6872058770669452
2021-05-04.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2021-05-04.txt 0.6866138676376796
2022-04-17.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2022-04-17.txt 0.6837786406828062
2025-03-10.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-03-10.txt 0.6825293816922051
2021-05-02.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2021-05-02.txt 0.6818701242339038
2025-03-08.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-03-08.txt 0.6804468955664654
2024-03-24.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-03-24.txt 0.6798798323221176
2022-02-24.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2022-02-24.txt 0.6779782723066287
2024-08-18.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-08-18.txt 0.676507830756482
2019-07-03.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2019-07-03.txt 0.6754137298987061
2021-12-22.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2021-12-22.txt 0.6747843533262554
2024-03-24.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-03-24.txt 0.6740836055290546

65
saved_output/2025_08_27.txt Normal file
View file

@ -0,0 +1,65 @@
Enter your query (or type 'exit' to quit): It's a weird refuge to refute nationality; to claim that all is a fraud, anyway. Still, it is the most sane reaction right now. The right to walk away. All else is slavery.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/docstore.json.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/index_store.json.
Response:
**Summary Theme:**
The texts explore complex issues related to freedom, equality, and justice, particularly within political and social contexts.
They discuss the limitations of current systems in addressing human rights and ethical standards, including prison treatment,
racial discrimination, and the expansion of citizenship rights. The texts also delve into the nature of revolutions, questioning
whether they benefit a select elite or are instigated by them.
**Matching Files:**
1. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2002-05-09.txt - This text discusses the treatment of
prisoners, highlighting a lack of adherence to constitutional standards and due process, as well as addressing issues related to
nationality and citizenship.
2. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-06-04.txt - A blog post discussing the idea of 'human
nature' in politics, with a focus on the importance of freedom and the critique of a political figure's policies.
3. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-10-13.txt - This passage explores the topic of white
male privilege and its implications in business, questioning why it is highlighted while overlooking broader systemic issues.
4. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-01-03.txt - The text delves into the idea of freedom
and imagination in the early 20th century, comparing it to the present day and discussing the constraints of democracy and
capitalism.
5. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2016-11-09.txt - A text addressing civil rights history
and the hate and anger that arise from it, questioning how to respond while avoiding tribalism and degeneration.
6. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-07-28.txt - Discussing legal issues and the
challenges of thinking about human rights in a multicultural context, particularly regarding people who are neither Christians nor
infidels.
7. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-01-29.txt - A personal reflection on current
political events and the author's difficulties in expressing feelings, tying into discussions of history and psychology.
8. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2001-09-13.txt - This text addresses the justification for
violent acts during a perceived war against fundamentalism, emphasizing economic and moral principles over nationhood.
9. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-06-03.txt - A passage on the concept of
incommensurability in politics and how consensus processes aim to reconcile different perspectives in practical situations.
10. file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2002-05-09.txt - Discussing the expansion of citizenship
rights in American history, highlighting key dates and milestones in this process.
Source documents:
2002-05-09.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2002-05-09.txt 0.6722719323340611
2025-06-04.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-06-04.txt 0.6608581763116415
2024-07-14.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-07-14.txt 0.6475284193414396
2025-06-04.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-06-04.txt 0.6468059334833061
2025-06-03.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-06-03.txt 0.6466041920182646
2016-11-09.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2016-11-09.txt 0.6451955555687188
2001-09-13.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2001-09-13.txt 0.6433104875230174
2025-01-04.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-01-04.txt 0.6356563682194852
2024-10-13.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-10-13.txt 0.6347407640363988
2025-01-03.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-01-03.txt 0.6336626187333729
2021-09-16.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2021-09-16.txt 0.6328042502815873
2025-07-28.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-07-28.txt 0.6324342333276086
2025-01-04.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-01-04.txt 0.6317671258192576
2025-01-29.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-01-29.txt 0.6313280704571994
2024-06-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-06-20.txt 0.629663790289146
Query processed in 95 seconds.

174
saved_output/2025_08_28.txt Normal file
View file

@ -0,0 +1,174 @@
Enter your query (or type 'exit' to quit): I'm looking for the happiest and most joyful passages.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/docstore.json.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/index_store.json.
Response:
**Summary Theme:**
The author reflects on moments of joy and happiness in their life, exploring themes such as contentment, love, and the beauty of
everyday experiences. They express a desire to let themselves be happy every day and find pleasure in creative pursuits like
poetry and art appreciation. Despite personal struggles with depression and anxiety, the author emphasizes the importance of
finding happiness in one's daily life.
**Matching Files:**
1. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2015-12-03.txt** — Chloe's smile while praising her
piano playing brings joy, highlighting the author's appreciation for small acts of kindness.
2. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2006-08-11.txt** — The author's day feeding carrots to
horses and making pizza with Matthew is described as "fun times, maybe the best ever," showcasing their ability to find joy in
simple pleasures.
3. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2015-01-23.txt** — Reading poetry and appreciating
simple observations brings positive thoughts, indicating a focus on finding happiness through creative pursuits.
4. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-07-25.txt** — The author reflects on the joys of
their life, such as time with family and the love they experienced with T, despite later experiencing heartache.
5. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2013-02-15.txt** — The passage encourages being joyful,
happy, pleased, and glad, aligning with the author's overall theme of finding happiness in various life experiences.
6. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2019-09-14.txt** — Reflecting on a week of learning,
teaching, and feeling curious leads to the realization that one can find happiness every day, emphasizing the author's ability to
let themselves be happy.
7. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2012-09-20.txt** — This file, titled "Ευδαιμονía,"
contains ancient Greek words related to happiness and well-being, further reinforcing the author's exploration of finding joy in
life.
8. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-07-29.txt** — The scorching weather and being
outside provide a backdrop to the author's ability to find happiness despite potential physical discomfort, demonstrating their
resilient outlook.
9. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-10-09.txt** — The author expresses frustration and
depression due to daily interactions but also acknowledges the importance of finding happiness in life, aligning with their
broader theme.
10. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-12-06.txt** — The passage defines happiness as
contentment and peacefulness, highlighting the author's pursuit of a joyful life through their experiences.
Source documents:
2025-07-29.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-07-29.txt 0.7135682886000794
2008-12-06.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-12-06.txt 0.7099131243276414
2009-06-04.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2009-06-04.txt 0.6973211899243362
2025-08-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-08-20.txt 0.6866097119060084
2013-02-15.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2013-02-15.txt 0.686259123672228
2012-09-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2012-09-20.txt 0.6790148415972938
2015-01-23.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2015-01-23.txt 0.6761073066656899
2015-12-03.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2015-12-03.txt 0.6712531329880593
2006-08-11.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2006-08-11.txt 0.6613670040827223
2024-07-25.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-07-25.txt 0.6570111677987235
2025-08-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-08-20.txt 0.6558116128405127
2019-09-14.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2019-09-14.txt 0.6549423349658567
2024-04-03.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-04-03.txt 0.6546862471469852
2023-07-24.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2023-07-24.txt 0.6544076938168284
2025-08-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-08-20.txt 0.6541587448214657
Query processed in 73 seconds.
---
This was a strange failure!
((.venv) ) ~/Library/CloudStorage/Dropbox/nd/ssearch/$ run_query.sh
Enter your query (or type 'exit' to quit): Find documents that express feelings of gratitude.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/docstore.json.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/index_store.json.
Response:
**Summary Theme:**
The query is about finding documents expressing feelings of gratitude. However, it seems there was an error in my interpretation
or the context provided, as the dominant themes I identified earlier were related to depression and anxiety rather than gratitude.
Based on the given context, the theme that matches the query is related to personal struggles with mental health, particularly
feelings of sadness and appreciation for connections.
**Matching Files:**
1. **/Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-10-09.txt** — Expressed frustration with joggers on the bike
path but did not mention gratitude.
2. **/Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-08-20.txt** — No direct expressions of gratitude found, but a
reflection on personal struggles and achievements was present.
3. **/Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-05-27.txt** — Focuses on negative emotions like anxiety and
anger, with no clear expressions of gratitude.
4. **/Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2013-05-23.txt** — Mentions the joy of helping others achieve their
goals, which could be interpreted as a form of appreciation or gratitude for their success and recognition.
5. **/Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2015-03-17.txt** — Contains suicidal thoughts and negative
feelings, indicating a lack of gratitude.
6. **/Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2023-07-16.txt** — Describes feelings of loss and the search for
meaning, devoid of expressions of gratitude.
7. **/Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-03-18.txt** — No clear mentions of gratitude found.
8. **/Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2007-05-31.txt** — Focuses on career concerns and negative
emotions, without expressing gratitude.
9. **/Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2020-05-13.txt** — Struggles with recognizing others' efforts due
to internal bad feelings, which contrasts the idea of gratitude.
10. **/Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2020-02-01.txt** — Mentions reconnecting with old friendships and
family, but there are no explicit expressions of gratitude.
Source documents:
2025-08-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-08-20.txt 0.6865291287082457
2008-05-27.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-05-27.txt 0.6707430757786356
2023-02-17.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2023-02-17.txt 0.6624994985797085
2025-08-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-08-20.txt 0.6614406157945066
2025-03-18.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-03-18.txt 0.6589271548285772
2025-08-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-08-20.txt 0.6583888795181797
2025-07-28.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-07-28.txt 0.6575634356770015
2012-09-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2012-09-20.txt 0.6564913212073614
2020-05-13.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2020-05-13.txt 0.6563809376620068
2025-08-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-08-20.txt 0.6549296468531686
2013-05-23.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2013-05-23.txt 0.653871795081564
2009-06-04.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2009-06-04.txt 0.6535844277567499
2007-05-31.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2007-05-31.txt 0.6524713123412845
2025-07-29.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-07-29.txt 0.6517446358739963
2020-02-01.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2020-02-01.txt 0.6514433384900066
Query processed in 74 seconds.
---
I implemented a regex that srtips the full path:
((.venv) ) ~/Library/CloudStorage/Dropbox/nd/ssearch/$ run_query.sh
Enter your query (or type 'exit' to quit): Entries that discuss testing one's limits, especially emotional and mental.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/docstore.json.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/index_store.json.
Response:
**Summary Theme:**
The dominant theme in this context appears to be an individual exploring their emotions, particularly their mental and emotional
boundaries, as well as the impact of societal perceptions on feelings. The writer grapples with anxiety, depression, self-worth,
and the fear of inadequacy while also contemplating their own mortality and purpose. They seek to understand and manage their
emotions, often viewing them as data or information that can guide survival and informed decision-making.
**Matching Files:**
1. **file_path: ./data/2023-07-16.txt** — Describes the struggle of wrestling with depression for years, emphasizing the search
for meaning in a world driven by efficiency and optimization.
2. **file_path: ./data/2015-03-17.txt** — Mentions suicidal thoughts and feeling overwhelmed by negative emotions, indicating a
desire to test one's limits emotionally.
3. **file_path: ./data/2019-01-14.txt** — Discusses the struggle with controlling impulses and feelings of stress, anxiety, and
depression while questioning if one is a prisoner of their biology.
4. **file_path: ./data/2025-06-17.txt** — Explores the concept of feeling out personal boundaries and accepting dissonance, which
could be seen as testing emotional limits.
5. **file_path: ./data/2025-08-20.txt** — Mentions the interest in anarchy while being invested in capital markets and holding a
tenured position, indicating a potential exploration of one's limits.
6. **file_path: ./data/2017-12-06.txt** — Expresses suicidal thoughts due to burnout and emotional exhaustion, suggesting an
attempt to test personal boundaries.
7. **file_path: ./data/2017-12-16.txt** — Explores the desire to be a better person and the struggle with balance, potentially
indicating a journey of testing one's limits.
8. **file_path: ./data/2017-04-13.txt** — Focuses on worrying about hypotheticals and imagined fights, suggesting an exploration
of personal boundaries and emotional limits.
9. **file_path: ./data/2024-09-20.txt** — Admitted to having depressive thoughts despite appearing jovial, indicating a discussion
on testing the limits of one's mental health.
10. **file_path: ./data/2025-08-20.txt** — The computer facilitates artistic innovation by freeing the artist from conventional
"mental ready-mades," enabling the production of new assemblages of shapes and colors.
Source documents:
2019-01-28.txt ./data/2019-01-28.txt 0.7091032318236316
2003-03-09.txt ./data/2003-03-09.txt 0.6819464422399241
2025-08-20.txt ./data/2025-08-20.txt 0.6796124657599102
2025-08-20.txt ./data/2025-08-20.txt 0.6785008440538487
2017-04-13.txt ./data/2017-04-13.txt 0.6768340197245936
2022-05-06.txt ./data/2022-05-06.txt 0.6750801120630013
2023-01-27.txt ./data/2023-01-27.txt 0.6703347559624786
2023-03-14.txt ./data/2023-03-14.txt 0.668340287632692
2025-06-17.txt ./data/2025-06-17.txt 0.6656929175939117
2025-08-20.txt ./data/2025-08-20.txt 0.6645024849162311
2023-07-16.txt ./data/2023-07-16.txt 0.6618312766890652
2021-04-15.txt ./data/2021-04-15.txt 0.661171288633267
2025-08-20.txt ./data/2025-08-20.txt 0.6600615010925119
2019-01-14.txt ./data/2019-01-14.txt 0.6563840810491259
2025-05-23.txt ./data/2025-05-23.txt 0.6561484407217757
Query processed in 79 seconds.

124
saved_output/2025_08_30.txt Normal file
View file

@ -0,0 +1,124 @@
((.venv) ) ~/Library/CloudStorage/Dropbox/nd/ssearch/$ run_query.sh
Enter your query (or type 'exit' to quit): You are a machine and you can program yourself.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/docstore.json.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/index_store.json.
Response:
### Summary Theme
The dominant theme from the provided context revolves around the concept of human agency and the transformative power of
self-programming, often referred to as "YOU ARE A MACHINE AND YOU CAN PROGRAM YOURSELF". This phrase encapsulates the idea that
individuals have the capability to upgrade their own mental and emotional states through conscious effort and learning. The
context explores this theme through various angles, including philosophical reflections on storytelling and human existence,
discussions of meditation and personal growth, and explorations of information replication and self-replication systems like DNA
and memes.
### Matching Files
1. **file_path: ./data/2024-09-21.txt** - The passage discusses Von Neumann's theory of self-replication, which ties into the idea
that individuals can replicate and "program" themselves through learning and development.
2. **file_path: ./data/2024-08-19.txt** - This snippet features a series of repetitions of "YOU ARE A MACHINE AND YOU CAN PROGRAM
YOURSELF," emphasizing the transformative power of self-programming and personal growth.
3. **file_path: ./data/2024-03-11.txt** - The author contemplates purpose, meaning, and the act of programming oneself through
writing and reflection, aligning with the self-programming theme.
4. **file_path: ./data/2023-07-16.txt** - A robot's inner struggles, including a desire to explore feelings and understand its own
existence, hint at the idea of self-programming and personal development.
5. **file_path: ./data/2024-04-11.txt** - The author's fascination with the materiality of computation suggests a connection to
understanding human existence through self-programming and self-replication.
6. **file_path: ./data/2024-02-13.txt** - The extensive list of tasks and projects the author wants to accomplish reflects a drive
for personal growth, akin to self-programming.
7. **file_path: ./data/2024-08-19.txt** - A discussion of information degradation and the relationship between DNA, memes, and
information replication hints at a deeper understanding through self-programming.
8. **file_path: ./data/2025-01-24.txt** - A detailed account of typing a program onto IBM cards and working with early computers
emphasizes the labor involved in creating and learning from technology, which can be seen as self-programming through the
acquisition of knowledge.
9. **file_path: ./data/2025-02-05.txt** - This passage raises questions about truth and human agency, which are closely tied to
the idea of self-programming and the ability to shape one's own existence through conscious effort.
10. **file_path: ./data/2022-01-22.txt** - The author relates meditation to "operating system updates," illustrating how
self-programming can lead to improved performance and functionality in the mind, much like a computer's software.
Source documents:
2021-02-12.txt ./data/2021-02-12.txt 0.7813853524305151
2021-03-12.txt ./data/2021-03-12.txt 0.7170262020422805
2021-03-22.txt ./data/2021-03-22.txt 0.7080438590471859
2025-02-05.txt ./data/2025-02-05.txt 0.700772619041579
2022-01-22.txt ./data/2022-01-22.txt 0.6946526808142116
2024-08-19.txt ./data/2024-08-19.txt 0.6909295863339957
2024-09-21.txt ./data/2024-09-21.txt 0.6863798746276172
2024-08-19.txt ./data/2024-08-19.txt 0.6811521050296564
2024-03-11.txt ./data/2024-03-11.txt 0.6776553751255855
2023-07-16.txt ./data/2023-07-16.txt 0.6734772841938028
2021-03-01.txt ./data/2021-03-01.txt 0.6703476982962236
2025-05-26.txt ./data/2025-05-26.txt 0.6699061717036373
2024-02-13.txt ./data/2024-02-13.txt 0.6675189407579228
2025-01-24.txt ./data/2025-01-24.txt 0.6661259191158485
2024-04-11.txt ./data/2024-04-11.txt 0.664854046786588
Query processed in 97 seconds.
Enter your query (or type 'exit' to quit): Summarize passages related to questions about truth and human agency.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/docstore.json.
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/index_store.json.
Response:
**Summary Theme:**
The texts explore the relationship between truth, knowledge, and human agency, highlighting how our understanding of reality is
shaped by interpretation and negotiation rather than an objective standard. They question the nature of self-awareness and
consciousness, suggesting that it arises from independent facts and truths beyond individual control. This perspective challenges
traditional notions of knowledge and ethics, suggesting that shared meaning and identity might be more influential than facts
themselves. The theme also delves into the implications of these ideas for governance, society, and the integration of diverse
epistemic frameworks.
**Matching Files:**
1. ./data/2025-03-08.txt - The passage emphasizes that truth is not fixed but a product of human interpretation, challenging the
idea of absolute knowledge and suggesting that our beliefs are subject to revision and refinement as we learn more about ourselves
and the world.
2. ./data/2025-02-14.txt - This snippet discusses truth as a social construct, prompting questions about ethical epistemology and
the potential role of AI in shaping epistemic environments. It also introduces the idea that knowledge is a product of shared
meaning and identity rather than just facts.
3. ./data/2025-02-14.txt - The text includes a quote suggesting that our concepts are self-created, which can both empower and
limit us, fostering critical thinking and personal responsibility while also potentially leading to disorientation and existential
uncertainty.
4. ./data/2025-03-08.txt - The implications of truth being a social construct are explored further, including the idea that
fact-checking alone doesn't address shared meaning and identity, leading to discussions about ethics, society, governance, and the
role of AI in shaping epistemic environments.
5. ./data/2025-03-08.txt - This file delves into the concept of "we are supplicants to our own fiction," exploring how humans
create meaning systems that can be comforting but potentially misleading or limiting, and emphasizing the importance of
self-awareness for critical thinking and personal growth.
6. ./data/2025-02-14.txt - The text raises questions about the nature of truth, reality, and human agency, inviting contemplation
on whether our stories are mere constructs or reflections of deeper aspects of human existence, and how we can navigate
storytelling to uncover accurate portrayals.
7. ./data/2025-03-08.txt - This passage continues the discussion on the implications of a social construct of truth, including the
potential role of AI in mediating competing epistemic frameworks and reducing polarization.
8. ./data/2010-12-30.txt - A statement that "there is no meaning and no purpose in life" is discussed, reflecting existentialist
philosophies, and raising questions about reconciling the tension between fiction and the search for meaning and purpose.
9. ./data/2025-03-08.txt - This snippet presents a list of resources related to knowledge, power, and institutions, including
Michel Foucault, Donna Haraway, Stefan Lorenz Sorgner, William James, and Noam Chomsky, reflecting on the relationship between
power and knowledge throughout history.
Source documents:
2006-12-27.txt ./data/2006-12-27.txt 0.7103349341421636
2025-02-14.txt ./data/2025-02-14.txt 0.6992770918721224
2025-03-08.txt ./data/2025-03-08.txt 0.686001774445945
2025-02-14.txt ./data/2025-02-14.txt 0.6743349162123844
2025-03-08.txt ./data/2025-03-08.txt 0.6733934128354977
2025-03-08.txt ./data/2025-03-08.txt 0.6706689033144045
2025-02-05.txt ./data/2025-02-05.txt 0.6702486733668184
2025-01-04.txt ./data/2025-01-04.txt 0.6699433363201491
2025-02-14.txt ./data/2025-02-14.txt 0.6691576672622886
2025-03-08.txt ./data/2025-03-08.txt 0.6670311145975771
2008-04-22.txt ./data/2008-04-22.txt 0.665624998848253
2025-02-06.txt ./data/2025-02-06.txt 0.6654464518589284
2010-12-30.txt ./data/2010-12-30.txt 0.663147445474458
2004-02-15.txt ./data/2004-02-15.txt 0.6625948924633361
2025-02-06.txt ./data/2025-02-06.txt 0.6608789240071589
Query processed in 92 seconds.

1
saved_output/README.txt Normal file
View file

@ -0,0 +1 @@
This directory contains collections of interesting output from the nd_ssearch query engine.

113
saved_output/compare command-r7b.md Normal file
View file

@ -0,0 +1,113 @@
# Generaterd by llama3.1:8B
Enter a search topic or question (or 'exit'):
Simplicity, peace, and acceptance.
**Summary Theme**
The dominant theme that emerges from the provided context is the pursuit of simplicity, peace, and acceptance as a means to find
meaning and contentment in life. The excerpts suggest that individuals often struggle with existential crises, anxiety, and
dissatisfaction, but through various philosophical and spiritual practices, they seek to cultivate a sense of inner peace and
harmony.
**Matching Files**
1. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-09-22.txt** — Suzuki discusses the importance of
letting go of intellectual pursuits and embracing the simplicity of life, feeling the "power of life" and being content with its
evolution.
2. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2015-02-12.txt** — The author reflects on their emptiness
and yearning for something deeper, wondering if they can relish in this feeling and explore it further.
3. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-02-27.txt** — Life is described as pain, but the
author finds solace in God and feels a deep connection to something universal, seeking to do good for others.
4. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2012-09-08.txt** — The text advises living life with
virtue above pleasure and tranquility above happiness, finding contentment in the present moment.
5. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2007-05-30.txt** — The author reflects on their
existential crisis and seeks to find meaning through meditation, exploring the wonder of life and the universe.
6. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-02-05.txt** — Alan Watts' measured pace and calm
tone are mentioned as soothing, inviting listeners to slow down and absorb his philosophical musings.
7. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2003-11-11.txt** — The author experiences a sense of
dissolution of the self and acceptance of mortality through music, finding hope in the peaceful and calm aspects of human
existence.
8. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2011-04-20.txt** — The text presents two contrasting
choices for raising children: to learn how to fight or navigate complex social interactions, leading to exhaustion and missteps.
9. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2003-11-11.txt** — Music is mentioned as a means to
connect with those who have passed and accept one's own mortality, finding hope in acceptance.
10. **file_path: /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-07-09.txt** — The author reflects on their own
flaws and limitations, seeking to cultivate peace and tranquility through meditation and philosophical insights.
These files prioritize the pursuit of simplicity, peace, and acceptance as a means to find meaning and contentment in life.
Source documents:
2008-09-22.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-09-22.txt 0.6942251115364034
2008-12-06.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-12-06.txt 0.69329826339918
2006-01-18.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2006-01-18.txt 0.6928289731862756
2024-07-09.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-07-09.txt 0.6851764077064736
2024-10-21.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-10-21.txt 0.6850957394630768
2021-05-15.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2021-05-15.txt 0.6792933726282656
2025-07-28.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-07-28.txt 0.677805020905822
2008-02-27.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-02-27.txt 0.6758790431127354
2025-02-05.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-02-05.txt 0.6751368515758781
2003-11-11.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2003-11-11.txt 0.6741012107117246
2015-02-12.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2015-02-12.txt 0.6724595748596391
2012-09-08.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2012-09-08.txt 0.6709374012666305
2007-05-30.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2007-05-30.txt 0.6705586893086012
2003-11-11.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2003-11-11.txt 0.6683483221331056
2011-04-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2011-04-20.txt 0.6679376031898634
# Generated by command-r7b
Enter a search topic or question (or 'exit'):
Simplicity, peace, and acceptance.
**Summary Theme:**
The dominant themes from the provided context revolve around personal growth, spirituality, and finding contentment through
simplicity, peace, and acceptance. The text emphasizes the idea that one should let go of intellectual pursuits and anxiety to feel
more content with life's challenges and find inner peace. It explores the concepts of Zen, tranquility, and the power of meditation
as a path to achieving this state of being. Additionally, the texts touch on the impact of personal experiences (like the birth of
a child) in fostering a sense of calm and connection with the divine.
**Matching Files:**
1. /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-09-22.txt - D.T. Suzuki's excerpt highlights the importance of
letting go of intellectual pursuits and focusing on the present moment to achieve peace and contentment, aligning with themes of
simplicity and acceptance.
2. /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2015-02-12.txt - This file discusses the emptiness and yearning for
deeper meaning, suggesting a journey towards personal peace and content in one's spiritual quest.
3. /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-12-06.txt - The excerpt promotes happiness through contentment
and peacefulness, echoing the themes of simplicity and acceptance.
4. /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2003-11-11.txt - The text explores the dissolution of the self and
finding peace in spiritual experiences, relating to themes of simplification and acceptance.
5. /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-10-21.txt - A reflection on human nature and violence, this
passage emphasizes the importance of letting go of aggression and finding peace through a peaceful mind.
6. /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-07-28.txt - This file mentions consensus-based processes and
Quaker values, which align with the themes of acceptance and tranquility in decision-making.
7. /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2012-09-08.txt - The excerpt promotes the idea of regulating thoughts
and actions with a view towards mortality, highlighting simplicity and tranquility in preparation for life's end.
8. /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2007-05-30.txt - The text discusses existential crises and finding
meaning through meditation and therapy, contributing to the theme of simplification through introspection.
9. /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2011-04-20.txt - While more focused on child-rearing, this passage
hints at themes of acceptance and tranquility in navigating complex social interactions.
10. /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2003-11-11.txt - The exploration of prayer and spiritual experiences
leads to the theme of acceptance as one sheds the veneer of life, revealing deeper human existence.
Source documents:
2008-09-22.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-09-22.txt 0.6942251115364034
2008-12-06.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-12-06.txt 0.69329826339918
2006-01-18.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2006-01-18.txt 0.6928289731862756
2024-07-09.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-07-09.txt 0.6851764077064736
2024-10-21.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2024-10-21.txt 0.6850957394630768
2021-05-15.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2021-05-15.txt 0.6792933726282656
2025-07-28.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-07-28.txt 0.677805020905822
2008-02-27.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2008-02-27.txt 0.6758790431127354
2025-02-05.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2025-02-05.txt 0.6751368515758781
2003-11-11.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2003-11-11.txt 0.6741012107117246
2015-02-12.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2015-02-12.txt 0.6724595748596391
2012-09-08.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2012-09-08.txt 0.6709374012666305
2007-05-30.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2007-05-30.txt 0.6705586893086012
2003-11-11.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2003-11-11.txt 0.6683483221331056
2011-04-20.txt /Users/furst/Library/CloudStorage/Dropbox/nd/ssearch/data/2011-04-20.txt 0.6679376031898634