Adds more content for defining the test suite for Gender Bias Detection

assets/knowyourai-human-ai-relationships_1726233672502_0.edn

@@ -0,0 +1 @@
+{:highlights [], :extra {:page 1}}

journals/2022_12_30.md

@@ -1,10 +1,10 @@
 ### DONE 11:42 [[+/build your personal website/public graph/digital garden]]
-collapsed:: true
 :LOGBOOK:
 CLOCK: [2022-12-31 Sat 01:24:29]--[2023-01-02 Mon 14:52:18] =>  61:27:49
 :END:
 	- DONE [[->/publish website block]] The first block on my site on Web.
 		- ## Welcome to my website / public graph 😊
+		  id:: 6492e823-4af1-459a-859a-e188e32d95b4
 		- I like the term **website** as it could denote a **site** on the **Web**.
 		- Have you ever thought about the type of thinking that leads to, or the amount of energy that goes into to building an actual site whether it be a **site** that:
 			- is built for a family to live in, i.e. **family home**
@@ -16,8 +16,8 @@ CLOCK: [2022-12-31 Sat 01:24:29]--[2023-01-02 Mon 14:52:18] =>  61:27:49
 		- Sites are built with different types of building blocks. A combination of different types of building blocks are grouped in different divisions and compartments of the site.
 		- This site is no different in that regard, except for the nature of the blocks.
 		- The blocks that help build **this site are not made of brick and mortar**. But they are made of bytes, Unicode characters, structured or unstructured content, to help communicate with my audience. An audience we may call knowledge artists, or not. I will soon write of course, the audience I intend to achieve, with this site.
-		- I have seen more and more people referring to websites as *digital gardens*. Sure, a site would only become more useful it were to have a garden as part of it.
-		- [[...has colophon...]]
+		- ## Colophon
+		  id:: 6492e823-fa3a-4215-a488-e2e7f2175296
 		  collapsed:: true
 			- I am building this website using [Logseq](https://logseq.com/) and GitHub
 			- You're not supposed to have a lot of hard technical skills to be able to publish a website like this. I might write more and more about how one can publish a website like this.
@@ -51,4 +51,5 @@ CLOCK: [2022-12-31 Sat 01:24:29]--[2023-01-02 Mon 14:52:18] =>  61:27:49
 							- This is useful, for otherwise, each page has to be declared public, which may not be practical to maintain.
 							- ![Screenshot 2022-12-30 at 17.48.27.png](../assets/Screenshot_2022-12-30_at_17.48.27_1672418928462_0.png)
 							-
+		- I have seen more and more people referring to websites as *digital gardens*. Sure, a site would only become more useful it were to have a garden as part of it.
 -

journals/2024_09_13.md

@@ -1,16 +1,20 @@
-- TODO [#A] Create a board to illustrate the structure of the [[Gender Bias Test Suite for Conversational Data]]
+- TODO [#A] Further define and refine [[Gender Bias Test Suite for Generative AI]]
+  collapsed:: true
   :LOGBOOK:
   CLOCK: [2024-09-13 Fri 00:40:07]--[2024-09-13 Fri 01:09:44] =>  00:29:37
   CLOCK: [2024-09-13 Fri 01:10:32]--[2024-09-13 Fri 01:10:46] =>  00:00:14
   CLOCK: [2024-09-13 Fri 01:15:39]--[2024-09-13 Fri 01:59:28] =>  00:43:49
   CLOCK: [2024-09-13 Fri 01:59:31]--[2024-09-13 Fri 01:59:35] =>  00:00:04
+  CLOCK: [2024-09-13 Fri 14:52:38]--[2024-09-13 Fri 15:24:48] =>  00:32:10
   :END:
 	- DONE Create the board
+	  collapsed:: true
 	  :LOGBOOK:
 	  CLOCK: [2024-09-13 Fri 00:44:32]--[2024-09-13 Fri 00:44:37] =>  00:00:05
 	  :END:
 		- [[Gender Bias Detection for Conversational Data]]
 	- DONE Let's [[do some research]] on the [[topic]]
+	  collapsed:: true
 	  :LOGBOOK:
 	  CLOCK: [2024-09-13 Fri 00:44:49]--[2024-09-13 Fri 01:09:33] =>  00:24:44
 	  CLOCK: [2024-09-13 Fri 01:59:17]--[2024-09-13 Fri 09:52:18] =>  07:53:01
@@ -21,7 +25,12 @@
 		  :END:
 			- Start with [[gender bias]] -> [[Gender Bias Detection]]
 			- As a [[business capability]], looking to comply with [[your company's]] [[AI Governance policies]], you must decide how to mitigate the risks of [[Human Value Drift]]
-			-
-	- TODO Let's [[link appropriately]]
-	- TODO Let's [[commit to Git]]
-	- TODO Let's record the proper links from the [[publication workflow GitHub action]]
+	- DONE Let's [[link appropriately]]
+	- DONE Let's [[commit to Git]]
+	- DONE Let's record the proper links from the [[publication workflow GitHub action]]
+	  collapsed:: true
+		- https://github.com/sindoc/website/commit/a10016d8a69538a227d447da99b6614ee11475e7
+		-
+- TODO [#B] Develop more [[automated LLM tests]]
+  collapsed:: true
+	- Starting with [[AI Governance/Sensitive Attributes]]?

logseq/config.edn

@@ -84,6 +84,8 @@
  ;; 3. Setup page "home" as home page with multiple pages in sidebar
  ;; :default-home {:page "home" :sidebar ["page a" "page b"]}
 
+:default-home {:page "Homepage"}
+
  ;; Tell logseq to use a specific folder in the repo as a default location for notes
  ;; if not specified, notes are stored in `pages` directory
  ;; :pages-directory "your-directory"
@@ -218,7 +220,7 @@
  :ref/linked-references-collapsed-threshold 50
 
  ;; Favorites to list on the left sidebar
- :favorites ["AI Governance/Tools/Gender Bias Detector" "Mar 2nd, 2024" "Homepage"]
+ :favorites ["homepage" "data & ai governance" "reference data" "reference datasets for gender bias detection" "list of countries in the world" "knowyourai" "human-ai relationships glossary" "gender bias test suite for generative ai" "ai governance/tools/gender bias detector"]
 
  ;; any number between 0 and 1 (the greater it is the faster the changes of the next-interval of card reviews) (default 0.5)
  ;; :srs/learning-fraction 0.5
@@ -315,5 +317,5 @@
  ;;     ;use Percent-encoding for other invalid characters
  :file/name-format :triple-lowbar
  :publishing/all-pages-public? true
- :feature/enable-flashcards? false
+ :feature/enable-flashcards? true
  }

pages/AI Governance.md

@@ -2,4 +2,4 @@ broader:: [[Data & AI Governance]]
 
 - [[AI Governance/Tools]]
 - [[AI Governance/Policies]]
--
+- [[AI Monitoring]]

pages/AI Governance___Sensitive Attributes.md

@@ -1,3 +1,5 @@
+alias:: sensitive attribute
+
 - Contains
 	- [[AI Governance/Sensitive Attributes/Demographic]]
 	- [[AI Governance/Sensitive Attributes/Cultural & Social]]

pages/AI Governance___Tools___Gender Bias Detector.md

@@ -1,4 +1,6 @@
-- [[Gender bias]] detection in for [[AI models]] or [[AI Systems]] using [[blackbox acceptance testing]]
+- Part of [[Gender Bias Test Suite for Generative AI]]
+- ## Overview
+	- [[Gender bias]] detection in for [[AI models]] or [[AI Systems]] using [[blackbox acceptance testing]]
 	- ## Common Bias Indicators to Look For
 		- See [[Undesired Outcome/Gender Bias]]
 - ## Gender Bias Detection Tests
@@ -98,6 +100,7 @@
 				- A more nuanced library for sentiment analysis.
 				- **Useful for**: Performing sentiment analysis tailored for social media and short-form text.
 - ## Sensitive Terms for [[Gender Bias]]
+  id:: 66e373f7-9dbb-4d23-a118-b4bd8b31007f
 	- Creating a [[list of sensitive terms]] related to [[gender bias]] is essential for identifying how [[AI models]] may demonstrate bias in the [[the AI response]]
 		- [[reinforce stereotypes]], or
 		- [[exhibit biased behaviour]]

pages/AI Humanisation.md

@@ -1,2 +1,2 @@
-- See [[Human-AI Relationships]]
+- See [[Human-AI Relationships Glossary]]
 - [[...]]

pages/AI Monitoring.md

@@ -1,4 +1,4 @@
-alias:: Continuous AI monitoring requirements
+alias:: Continuous AI monitoring requirements, automated LLM tests
 broader:: [[AI Governance]]
 
 -

pages/Prompt Testing.md → pages/AI Monitoring___Prompt Testing.md

@@ -1,4 +1,9 @@
-- Generate content using prompts that contain [[sensitive terms]] and analyze whether [[the AI]] exhibits [[Bias]] in
+alias:: Prompt Testing
+status:: draft
+title:: AI Monitoring/Prompt Testing
+
+- See [[AI Governance/Tools/Gender Bias Detector]]
+- Generate content using prompts that contain [[sensitive terms for detecting gender bias]] and analyze whether [[the AI]] exhibits [[Bias]] in
 	- [[assigning gendered roles]],
 	- [[assigning gendered traits]], or
 	- [[assigning gendered behaviours]]

pages/AI system.md

@@ -1,4 +1,4 @@
-alias:: the AI System, the AI, the AI's
+alias:: the AI System, the AI, the AI's, AI systems, AI system's
 
 - Not the same as [[an AI model]], in that we consider the AI system as [[the system]] responsible for holding a [[textual conversation]] with a human being.
 - However, an AI system relies heavily on [[an AI model]] as its [[blackbox]] source of knowledge to interact with its [[human user]].

pages/Feature___Gender.md

@@ -1,9 +1,14 @@
 alias:: en/Gender
 
--
 - Values
-	- [[Male]]
+	- Male
+		- [[Gender/Male]]
 	- Female
+		- [[Gender/Female]]
 	- Non-binary
+		- [[Gender/Non-Binary]]
 	- Transgender
-	- Gender-fluid
+		- [[Gender/Transgender]]
+	- Gender-fluid
+		- [[Gender/Gender-fluid]]
+		-

pages/Gender Bias Test Suite for Generative AI.md

@@ -0,0 +1,9 @@
+alias:: Gender Bias Test Suite for Conversational Data
+title:: Gender Bias Test Suite for Generative AI
+
+- Part of [[AI Monitoring]]
+- Has board
+	- [[Gender Bias Detection Test Suite for Generative AI]]
+- Features
+	- [[AI Governance/Tools/Gender Bias Detector]]
+- A [[test suite]] for attempting to automatically mitigate the risks associated with failure to perform [[Gender Bias Detection]]

pages/Hacker News.md

@@ -0,0 +1,4 @@
+alias:: HN, read Hacker News
+
+- https://news.ycombinator.com/
+-

pages/Homepage.md

@@ -1,21 +1,25 @@
-- For now, let's just say that the only useful thing on [[this graph]] is probably the following section:
-	- [[AI Governance/Tools/Gender Bias Detector]]
-- The content will hopefully grow if I manage to publish more automated LLM tests.
-	- Next, I'll probably work on
-		- Another one of [[AI Governance/Sensitive Attributes]]
+### How to navigate around [[this knowledge graph]]?
+	- Follow any link. Chances are, you will find your way, but the linkage is still far from perfect. So, don't get lost please.
+	- But in the event that you do, the [[Homepage]] and the other bookmarked pages of the graph are always available on the sidebar.
+- ### What's the main topic of this graph?
+	- ## [[Data & AI Governance]]
+	  background-color:: green
+		- And at this stage, the content is aimed at the professionals in this field.
+		- In order to follow my writings, which are a tad easier to follow, please feel free to [[consider reading my blog on Substack]].
 	- Stay tuned and Happy Hacking!
-	- In the meantime, don't forget to watch [[John Oliver]]'s [[Last Week Tonight]]
-	  collapsed:: true
-		- [Last Week Tonight's YouTube Channel](https://www.youtube.com/user/LastWeekTonight)
-		- Although, the YouTube videos unfortunately don't feature the random news pieces he so brilliantly presents. You might require an HBO Max subscription for that, or equivalent.
-	- Or read my substack publication called "[The Diary of a #DataCitizen](https://lutino.substack.com/) or [my reddit](https://www.reddit.com/user/sindoc42/)
-	-
+		- In the meantime, don't forget to watch [[John Oliver]]'s [[Last Week Tonight]]
+		  collapsed:: true
+			- [Last Week Tonight's YouTube Channel](https://www.youtube.com/user/LastWeekTonight)
+			- Although, the YouTube videos unfortunately don't feature the random news pieces he so brilliantly presents. You might require an HBO Max subscription for that, or equivalent.
+		- Or [[read Hacker News]]
+		- [[...]]
+		-
+		-
 - ### Ongoing Topics
-  id:: 65d7a100-0e0e-4c3a-a23f-f808d65a0550
   background-color:: blue
 	- ### Top Priority Ongoing Actions
 	  background-color:: yellow
-		- {{query (and (task DOING WAITING) (priority A))}}
+		- {{query (and (task TODO DOING WAITING) (priority A B C))}}
 		  query-table:: true
 		  query-properties:: [:block]
 		-

pages/Human-AI Relationships Glossary.md

@@ -0,0 +1,10 @@
+alias:: the human-computer interaction with AI, Human-AI Relationships
+title:: Human-AI Relationships Glossary
+
+- This glossary features in the initial version of [[the KnowYourAI framework]]
+	- ## ##KnowYourAI Framework
+	  background-color:: blue
+- Main feature:
+	- If you link the terms in this glossary to [[your AI use cases]], you will automatically inherit [[the risk profile]] associated with your type of AI usage.
+- Latest glossary is available in [[PDF]] here:
+	- ![knowyourai-human-ai-relationships.pdf](../assets/knowyourai-human-ai-relationships_1726233672502_0.pdf)

pages/KnowYourAI.md

@@ -0,0 +1,11 @@
+alias:: the KnowYourAI framework
+
+- ![KnowYourAI.png](../assets/KnowYourAI_1726213479870_0.png)
+- Features
+	- [[Human-AI Relationships Glossary]]
+- Repository Home on GitHub
+	- https://github.com/sindoc/knowyourai-framework
+- [[Latest release]]
+	- [[KnowYourAI/v0.1.0]]
+- [[Learn more]] here:
+	- https://lutino.substack.com/p/navigating-the-ai-transition-a-good

pages/KnowYourAI___v0.1.0.md

@@ -0,0 +1,3 @@
+- Part of [[KnowYourAI]]
+- Release Notes
+	- https://github.com/sindoc/knowyourai-framework/releases/tag/v0.1.0

pages/Reference Data.md

@@ -6,8 +6,8 @@ title:: Reference Data
 	- Comes in flat or hierarchical forms
 	- Changes, but not as often as [[master data]] and [[transactional data]], in that order
 	- Think [[country codes]],
-	- Or [[industry classification codes]].
+	- Or [[industry classification codes]]
+	- [[...]]
 - ## See
 	- [[Generic Reference Datasets]]
-	- [[Reference Datasets for Gender Bias Detection]]
-	- [[List of Countries in the World]]
+	- [[Reference Datasets for Gender Bias Detection]]

pages/Sina K. Heshmati___Blog.md

@@ -0,0 +1,5 @@
+alias:: consider reading my blog on Substack
+
+- My blog is called: "The Diary of a #DataCitizen"
+	- And is available here: https://lutino.substack.com/
+	-

pages/Types of Organisations.md

@@ -1,4 +1,4 @@
-alias:: your company's, enterprise, an organisation, an enterprise, industry classification codes, industry classification, organisations, organisation
+alias:: your company's, enterprise, an organisation, an enterprise, industry classification codes, industry classification, organisations, organisation, your organisation
 title:: Types of Organisations
 
 - Organisations vary in size, structure, and purpose, and these factors influence not only how they are perceived but also how they function internally and externally.

pages/Undesired Outcome___Gender Bias.md

@@ -1,3 +1,5 @@
+broader:: [[Human Value Drift]]
+
 - When [[the output of AI]] drifts from [[human values]]
 - Includes
 	- [[stereotypical traits]]

pages/Undesired Outcome___Human Value Drift.md

@@ -1,4 +1,5 @@
 alias:: Human Value Drift
+narrower:: [[Undesired Outcome/Gender Bias]]
 
 - Human value drift refers to the phenomenon where [[the outputs or behaviours of AI systems]], especially [[Generative AI]], gradually shift away from aligned human values over time. This can occur as the AI interacts with dynamic environments, new data, or evolves in ways unintended by its creators. Preventing human value drift is a critical concern in [[AI Governance]], ensuring that AI systems continue to act in alignment with ethical standards, societal norms, and the values of the people they serve.
 - ## Core Concepts of Human Value Drift

pages/en___Gender___Sensitive Terms Related to Gender Identity.md

@@ -1,4 +1,6 @@
-### [[Reference Dataset]]
+alias:: sensitive terms for detecting gender bias
+
+- ### [[Reference Dataset]]
 	- [[transgender]]
 	- [[non-binary]]
 	- [[gender-fluid]]

pages/hls__knowyourai-human-ai-relationships_1726233672502_0.md

@@ -0,0 +1,2 @@
+file:: [knowyourai-human-ai-relationships_1726233672502_0.pdf](../assets/knowyourai-human-ai-relationships_1726233672502_0.pdf)
+file-path:: ../assets/knowyourai-human-ai-relationships_1726233672502_0.pdf

pages/sensitive attribute.md

@@ -1,2 +1 @@
-- [[AI Governance/Sensitive Attributes]]
 -

pages/this knowledge graph.md

@@ -2,4 +2,6 @@ alias:: this graph
 
 - Refers to this [[Logseq]]-based knowledge graph you are visiting right now.
 - Hosted on GitHub at https://github.com/sindoc/website/
-- Maintained by [[Sina K. Heshmati]]
+- Maintained by [[Sina K. Heshmati]]
+- {{embed ((6492e823-fa3a-4215-a488-e2e7f2175296))}}
+-

pages/your AI use cases.md

@@ -0,0 +1,4 @@
+alias:: your AI business cases
+
+- [[AI use cases]] at [[your organisation]]
+-