[Bug]: default values of prompt when install and upgrade #1092
Description
Describe the bug
Following the semantic refactor in PR #882, we need to audit the newly introduced PromptConf default values. The goal is to ensure a seamless experience for both new users and those upgrading from previous versions.
The current implementation defines the following default in code:
MemMachine/src/memmachine/common/configuration/__init__.py
Lines 144 to 166 in aaea7b7
prompt:
# Categories assigned to org-level semantic memory
default_org_categories:
- profile_prompt
# Categories assigned to project-level semantic memory
default_project_categories:
- profile_prompt
- writing_assistant_prompt
- coding_prompt
# Categories assigned to user-level semantic memory
default_user_categories:
- profile_prompt
# Empty by default — uses built-in defaults when blank
episode_summary_system_prompt_path: ""
episode_summary_user_prompt_path: ""
The prompt in sample config is https://github.com/MemMachine/MemMachine/blob/main/sample_configs/episodic_memory_config.cpu.sample#L26-L28
prompt:
default_project_categories:
- profile_prompt
Steps to reproduce
Fresh install
- In
configuration.yml, it is set to
default_project_categories:
- profile_prompt
- However, note that default values defined in code will still set
default_org_categoriestoprofile_promptanddefault_user_categoriestoprofile_prompt - So after ingestion, user will see org level set_ids and user_level set_ids, for example
mem_set_type_org_universal_0_46b9dd2b0ba8__
mem_user_set_org_universal_1_7e8d0b20c039__producer_id_user
...
- There will be features extracted at org_level and user_level by default
set_id | semantic_category_id | tag_id | feature | value
---------------------------------------------+----------------------+-------------------------------+-------------------------------------+-----------------------------------------------------------------------------------------------
mem_set_type_org_universal_0_46b9dd2b0ba8__ | profile | Health & Wellness | allergies | Severe peanut allergy
mem_set_type_org_universal_0_46b9dd2b0ba8__ | profile | Demographic Information | age | 29
mem_set_type_org_universal_0_46b9dd2b0ba8__ | profile | Demographic Information | upcoming_birthday | Turning 30 next year
set_id | semantic_category_id | tag_id | feature | value
----------------------------------------------------------------------+----------------------+--------------------------------------------+-------------------------------------+-----------------------------------------------------------------------------------------------
mem_user_set_org_universal_1_7e8d0b20c039__producer_id_user_xqs8b2yo | profile | Health & Wellness | peanut_allergy | User has a severe peanut allergy.
mem_user_set_org_universal_1_7e8d0b20c039__producer_id_user_xqs8b2yo | profile | Hobbies & Interests | cuisine_preference | User loves Italian cuisine.
mem_user_set_org_universal_1_7e8d0b20c039__producer_id_user_xqs8b2yo | profile | Career & Work Preferences | job_title | senior product manager
mem_user_set_org_universal_1_7e8d0b20c039__producer_id_user_xqs8b2yo | profile | Career & Work Preferences | team_composition | engineers
mem_user_set_org_universal_1_7e8d0b20c039__producer_id_user_xqs8b2yo | profile | Career & Work Preferences | role_level | senior
Upgrade
- In the release v0.2.6 and before, the prompt in
configuration.ymlis set to
prompt:
session:
- profile_prompt
- Note that once we upgrade to the latest image from main, the prompt settings will set to the default values in the code. This means those settings will take effect silently without a manual update to the config. Should we make sure this is explicitly mentioned to the users so they aren't surprised by the change in behavior?
default_org_categories:
- profile_prompt
# Categories assigned to project-level semantic memory
default_project_categories:
- profile_prompt
- writing_assistant_prompt
- coding_prompt
# Categories assigned to user-level semantic memory
default_user_categories:
- profile_prompt
- Current behavior is that user will see many features extracted for different combinations of set_ids and semantic_category_ids
-- Features by set_id / semantic_category_id:
set_id | semantic_category_id | cnt
--------------------------------------------------------------------------------------+----------------------+-----
mem_project_set_org_universal_project_project_u2jbfxnc_both_0_46b9dd2b0ba8__ | coding_style | 35
mem_project_set_org_universal_project_project_u2jbfxnc_both_0_46b9dd2b0ba8__ | profile | 28
mem_project_set_org_universal_project_project_u2jbfxnc_both_0_46b9dd2b0ba8__ | writing_assistant | 11
mem_project_set_org_universal_project_project_u2jbfxnc_empty_fields_0_46b9dd2b0ba8__ | coding_style | 26
mem_project_set_org_universal_project_project_u2jbfxnc_empty_fields_0_46b9dd2b0ba8__ | profile | 19
mem_project_set_org_universal_project_project_u2jbfxnc_empty_fields_0_46b9dd2b0ba8__ | writing_assistant | 3
mem_project_set_org_universal_project_project_u2jbfxnc_semantic_0_46b9dd2b0ba8__ | profile | 38
mem_project_set_org_universal_project_project_u2jbfxnc_semantic_0_46b9dd2b0ba8__ | coding_style | 34
mem_project_set_org_universal_project_project_u2jbfxnc_semantic_0_46b9dd2b0ba8__ | writing_assistant | 24
mem_set_type_org_universal_0_46b9dd2b0ba8__ | profile | 97
mem_user_set_org_universal_1_7e8d0b20c039__producer_id_admin_u2jbfxnc | profile | 6
mem_user_set_org_universal_1_7e8d0b20c039__producer_id_agent_u2jbfxnc | profile | 14
mem_user_set_org_universal_1_7e8d0b20c039__producer_id_user | profile | 4
mem_user_set_org_universal_1_7e8d0b20c039__producer_id_user_u2jbfxnc | profile | 56
Expected behavior
Seamless experience for both fresh install and upgrade with explicit config values taking effect.
Environment
- Commit:
aaea7b7
Additional context
No response