Posts

Showing posts with the label AGI alignment

Ah Motiva 3: The context of the concept of value

1. Background 2. Why even talk about values? 2.1. Correlated coverage tends to be founded on values 2.2. Corrigibility handles are founded on values 2.3. Constraints, handles, desiderata, antidesiderata 2.4. Constraints and handles related to values 3. Where do values come from? 4. The fact-value distinction 4.1. The basic fact-value distinction 4.2. Complications with the distinction 4.3. What is the type of "value"? 4.4. Preciser fact-value distinctions 1. Background This is the third essay in a series under the title "A hermeneutic Movement of the idea of values". This essay is a mix of old notes and some new meditations. The previous essay is " Ah Motiva 2: Relating values and novelty ". 2. Why even talk about values? In short: we don't have any idea what values actually are, and we probably need to, and it would probably be very helpful. In more words: The fundamental question of rationality is Why do you believe what you be...

Ah Motiva 2: Relating values and novelty

1. Background 2. Capable minds with specifiable effects 3. The idea of values is promissory 3.1. Using the idea of values to specify effects 3.2. Human wanting 3.3. Aside on ideas vs. concepts 3.4. Promissoriness asks for holding off on demarcation 4. Are values essentially diasystemic? 4.1. Example: Self-regenerating friendship 4.2. Human values are diasystemic 4.3. Values require reference 4.4. Self-interpretive metavalues produce diasystemically novel values 1. Background This is the second essay in a series under the title "A hermeneutic Movement of the idea of values". This essay is a mix of old notes and some new meditations. The previous essay is " Ah Motiva 1: Words about values ". 2. Capable minds with specifiable effects The starting point of AGI alignment is the question of how to make a mind that is highly capable, and whose ultimate effects are determined by the judgement of human operators. In other words, the mind should empower...

Ah Motiva 1: Words about values

1. Background 2. Explicating etymons 3. Want 4. Try, attempt 5. Plan 6. Intent, interest 7. Matter 8. Desire 9. Care 10. Pursue, control 11. Will, volition, wield, value 12. Select, decide 13. Choose, taste, aesthetic 14. Drive, motive 15. Moral 16. Free, proper 17. Yearn 18. Wish 19. Aim 20. Need 1. Background This is a first essay in what may or may not be a series of essays, under the title "A hermeneutic Movement of the idea of values". Some of these essays will be a mix of old notes and new meditations. These essays are aimed at doing philosophical background work towards understanding values. This is in the context of addressing core issues of aligned AGI , especially the problem of what determines a mind's effects . Human values are subtle and multi-aspectual , partly in ways that don't much affect de novo mind design, but probably partly in ways that do affect that design challenge. Far from being a question of identifying endosystemic...