Initial commit: RAG pipeline for semantic search over personal journal archive
Vector search with cross-encoder re-ranking, hybrid BM25+vector retrieval, incremental index updates, and multiple LLM backends (Ollama local, OpenAI API).
This commit is contained in:
Eric
commit
e9fc99ddc6
43 changed files with 7349 additions and 0 deletions
124
saved_output/2025_08_30.txt
Normal file
124
saved_output/2025_08_30.txt
Normal file
|
|
@ -0,0 +1,124 @@
|
|||
((.venv) ) ~/Library/CloudStorage/Dropbox/nd/ssearch/$ run_query.sh
|
||||
Enter your query (or type 'exit' to quit): You are a machine and you can program yourself.
|
||||
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/docstore.json.
|
||||
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/index_store.json.
|
||||
|
||||
Response:
|
||||
|
||||
### Summary Theme
|
||||
The dominant theme from the provided context revolves around the concept of human agency and the transformative power of
|
||||
self-programming, often referred to as "YOU ARE A MACHINE AND YOU CAN PROGRAM YOURSELF". This phrase encapsulates the idea that
|
||||
individuals have the capability to upgrade their own mental and emotional states through conscious effort and learning. The
|
||||
context explores this theme through various angles, including philosophical reflections on storytelling and human existence,
|
||||
discussions of meditation and personal growth, and explorations of information replication and self-replication systems like DNA
|
||||
and memes.
|
||||
|
||||
### Matching Files
|
||||
1. **file_path: ./data/2024-09-21.txt** - The passage discusses Von Neumann's theory of self-replication, which ties into the idea
|
||||
that individuals can replicate and "program" themselves through learning and development.
|
||||
2. **file_path: ./data/2024-08-19.txt** - This snippet features a series of repetitions of "YOU ARE A MACHINE AND YOU CAN PROGRAM
|
||||
YOURSELF," emphasizing the transformative power of self-programming and personal growth.
|
||||
3. **file_path: ./data/2024-03-11.txt** - The author contemplates purpose, meaning, and the act of programming oneself through
|
||||
writing and reflection, aligning with the self-programming theme.
|
||||
4. **file_path: ./data/2023-07-16.txt** - A robot's inner struggles, including a desire to explore feelings and understand its own
|
||||
existence, hint at the idea of self-programming and personal development.
|
||||
5. **file_path: ./data/2024-04-11.txt** - The author's fascination with the materiality of computation suggests a connection to
|
||||
understanding human existence through self-programming and self-replication.
|
||||
6. **file_path: ./data/2024-02-13.txt** - The extensive list of tasks and projects the author wants to accomplish reflects a drive
|
||||
for personal growth, akin to self-programming.
|
||||
7. **file_path: ./data/2024-08-19.txt** - A discussion of information degradation and the relationship between DNA, memes, and
|
||||
information replication hints at a deeper understanding through self-programming.
|
||||
8. **file_path: ./data/2025-01-24.txt** - A detailed account of typing a program onto IBM cards and working with early computers
|
||||
emphasizes the labor involved in creating and learning from technology, which can be seen as self-programming through the
|
||||
acquisition of knowledge.
|
||||
9. **file_path: ./data/2025-02-05.txt** - This passage raises questions about truth and human agency, which are closely tied to
|
||||
the idea of self-programming and the ability to shape one's own existence through conscious effort.
|
||||
10. **file_path: ./data/2022-01-22.txt** - The author relates meditation to "operating system updates," illustrating how
|
||||
self-programming can lead to improved performance and functionality in the mind, much like a computer's software.
|
||||
|
||||
Source documents:
|
||||
2021-02-12.txt ./data/2021-02-12.txt 0.7813853524305151
|
||||
2021-03-12.txt ./data/2021-03-12.txt 0.7170262020422805
|
||||
2021-03-22.txt ./data/2021-03-22.txt 0.7080438590471859
|
||||
2025-02-05.txt ./data/2025-02-05.txt 0.700772619041579
|
||||
2022-01-22.txt ./data/2022-01-22.txt 0.6946526808142116
|
||||
2024-08-19.txt ./data/2024-08-19.txt 0.6909295863339957
|
||||
2024-09-21.txt ./data/2024-09-21.txt 0.6863798746276172
|
||||
2024-08-19.txt ./data/2024-08-19.txt 0.6811521050296564
|
||||
2024-03-11.txt ./data/2024-03-11.txt 0.6776553751255855
|
||||
2023-07-16.txt ./data/2023-07-16.txt 0.6734772841938028
|
||||
2021-03-01.txt ./data/2021-03-01.txt 0.6703476982962236
|
||||
2025-05-26.txt ./data/2025-05-26.txt 0.6699061717036373
|
||||
2024-02-13.txt ./data/2024-02-13.txt 0.6675189407579228
|
||||
2025-01-24.txt ./data/2025-01-24.txt 0.6661259191158485
|
||||
2024-04-11.txt ./data/2024-04-11.txt 0.664854046786588
|
||||
Query processed in 97 seconds.
|
||||
|
||||
Enter your query (or type 'exit' to quit): Summarize passages related to questions about truth and human agency.
|
||||
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/docstore.json.
|
||||
Loading llama_index.core.storage.kvstore.simple_kvstore from ./storage_exp/index_store.json.
|
||||
|
||||
Response:
|
||||
|
||||
**Summary Theme:**
|
||||
The texts explore the relationship between truth, knowledge, and human agency, highlighting how our understanding of reality is
|
||||
shaped by interpretation and negotiation rather than an objective standard. They question the nature of self-awareness and
|
||||
consciousness, suggesting that it arises from independent facts and truths beyond individual control. This perspective challenges
|
||||
traditional notions of knowledge and ethics, suggesting that shared meaning and identity might be more influential than facts
|
||||
themselves. The theme also delves into the implications of these ideas for governance, society, and the integration of diverse
|
||||
epistemic frameworks.
|
||||
|
||||
**Matching Files:**
|
||||
|
||||
1. ./data/2025-03-08.txt - The passage emphasizes that truth is not fixed but a product of human interpretation, challenging the
|
||||
idea of absolute knowledge and suggesting that our beliefs are subject to revision and refinement as we learn more about ourselves
|
||||
and the world.
|
||||
|
||||
2. ./data/2025-02-14.txt - This snippet discusses truth as a social construct, prompting questions about ethical epistemology and
|
||||
the potential role of AI in shaping epistemic environments. It also introduces the idea that knowledge is a product of shared
|
||||
meaning and identity rather than just facts.
|
||||
|
||||
3. ./data/2025-02-14.txt - The text includes a quote suggesting that our concepts are self-created, which can both empower and
|
||||
limit us, fostering critical thinking and personal responsibility while also potentially leading to disorientation and existential
|
||||
uncertainty.
|
||||
|
||||
4. ./data/2025-03-08.txt - The implications of truth being a social construct are explored further, including the idea that
|
||||
fact-checking alone doesn't address shared meaning and identity, leading to discussions about ethics, society, governance, and the
|
||||
role of AI in shaping epistemic environments.
|
||||
|
||||
5. ./data/2025-03-08.txt - This file delves into the concept of "we are supplicants to our own fiction," exploring how humans
|
||||
create meaning systems that can be comforting but potentially misleading or limiting, and emphasizing the importance of
|
||||
self-awareness for critical thinking and personal growth.
|
||||
|
||||
6. ./data/2025-02-14.txt - The text raises questions about the nature of truth, reality, and human agency, inviting contemplation
|
||||
on whether our stories are mere constructs or reflections of deeper aspects of human existence, and how we can navigate
|
||||
storytelling to uncover accurate portrayals.
|
||||
|
||||
7. ./data/2025-03-08.txt - This passage continues the discussion on the implications of a social construct of truth, including the
|
||||
potential role of AI in mediating competing epistemic frameworks and reducing polarization.
|
||||
|
||||
8. ./data/2010-12-30.txt - A statement that "there is no meaning and no purpose in life" is discussed, reflecting existentialist
|
||||
philosophies, and raising questions about reconciling the tension between fiction and the search for meaning and purpose.
|
||||
|
||||
9. ./data/2025-03-08.txt - This snippet presents a list of resources related to knowledge, power, and institutions, including
|
||||
Michel Foucault, Donna Haraway, Stefan Lorenz Sorgner, William James, and Noam Chomsky, reflecting on the relationship between
|
||||
power and knowledge throughout history.
|
||||
|
||||
Source documents:
|
||||
2006-12-27.txt ./data/2006-12-27.txt 0.7103349341421636
|
||||
2025-02-14.txt ./data/2025-02-14.txt 0.6992770918721224
|
||||
2025-03-08.txt ./data/2025-03-08.txt 0.686001774445945
|
||||
2025-02-14.txt ./data/2025-02-14.txt 0.6743349162123844
|
||||
2025-03-08.txt ./data/2025-03-08.txt 0.6733934128354977
|
||||
2025-03-08.txt ./data/2025-03-08.txt 0.6706689033144045
|
||||
2025-02-05.txt ./data/2025-02-05.txt 0.6702486733668184
|
||||
2025-01-04.txt ./data/2025-01-04.txt 0.6699433363201491
|
||||
2025-02-14.txt ./data/2025-02-14.txt 0.6691576672622886
|
||||
2025-03-08.txt ./data/2025-03-08.txt 0.6670311145975771
|
||||
2008-04-22.txt ./data/2008-04-22.txt 0.665624998848253
|
||||
2025-02-06.txt ./data/2025-02-06.txt 0.6654464518589284
|
||||
2010-12-30.txt ./data/2010-12-30.txt 0.663147445474458
|
||||
2004-02-15.txt ./data/2004-02-15.txt 0.6625948924633361
|
||||
2025-02-06.txt ./data/2025-02-06.txt 0.6608789240071589
|
||||
Query processed in 92 seconds.
|
||||
|
||||
Loading…
Add table
Add a link
Reference in a new issue