mirror of
https://github.com/kennethnym/freya
synced 2026-07-02 14:21:14 +01:00
Compare commits
9 Commits
feat/add-g
...
feat/agent
| Author | SHA1 | Date | |
|---|---|---|---|
|
af4df2cd2c
|
|||
| 952f8e4fb0 | |||
| 2e6cae4d02 | |||
| 8cf38d609b | |||
| e6af1b7851 | |||
| 769fd5c77d | |||
| 6cc0f7669a | |||
| 63e71fb828 | |||
| e9f97d6f02 |
134
.agents/skills/upgrading-expo/SKILL.md
Normal file
134
.agents/skills/upgrading-expo/SKILL.md
Normal file
@@ -0,0 +1,134 @@
|
||||
---
|
||||
name: upgrading-expo
|
||||
description: Guidelines for upgrading Expo SDK versions and fixing dependency issues
|
||||
version: 1.0.0
|
||||
license: MIT
|
||||
---
|
||||
|
||||
## References
|
||||
|
||||
- ./references/react-19.md -- SDK +54: React 19 changes (useContext → use, Context.Provider → Context, forwardRef removal)
|
||||
- ./references/new-architecture.md -- SDK +53: New Architecture migration guide
|
||||
- ./references/react-compiler.md -- SDK +54: React Compiler setup and migration guide
|
||||
- ./references/native-tabs.md -- SDK +55: Native tabs changes (Icon/Label/Badge now accessed via NativeTabs.Trigger.\*)
|
||||
- ./references/expo-av-to-audio.md -- SDK +55: Migrate audio playback and recording from expo-av to expo-audio
|
||||
- ./references/expo-av-to-video.md -- SDK +55: Migrate video playback from expo-av to expo-video
|
||||
- ./references/react-navigation-to-expo-router.md -- SDK +56: Migrate `@react-navigation/*` imports to `expo-router` entry points (codemod + manual mapping)
|
||||
|
||||
## Beta/Preview Releases
|
||||
|
||||
Beta versions use `.preview` suffix (e.g., `55.0.0-preview.2`), published under `@next` tag.
|
||||
|
||||
Check if latest is beta: https://exp.host/--/api/v2/versions (look for `-preview` in `expoVersion`)
|
||||
|
||||
```bash
|
||||
npx expo install expo@next --fix # install beta
|
||||
```
|
||||
|
||||
## Step-by-Step Upgrade Process
|
||||
|
||||
1. Upgrade Expo and dependencies
|
||||
|
||||
```bash
|
||||
npx expo install expo@latest
|
||||
npx expo install --fix
|
||||
```
|
||||
|
||||
2. Run diagnostics: `npx expo-doctor`
|
||||
|
||||
3. Clear caches and reinstall
|
||||
|
||||
```bash
|
||||
npx expo export -p ios --clear
|
||||
rm -rf node_modules .expo
|
||||
watchman watch-del-all
|
||||
```
|
||||
|
||||
## Breaking Changes Checklist
|
||||
|
||||
- Check for removed APIs in release notes
|
||||
- Update import paths for moved modules
|
||||
- Review native module changes requiring prebuild
|
||||
- Test all camera, audio, and video features
|
||||
- Verify navigation still works correctly
|
||||
|
||||
## Prebuild for Native Changes
|
||||
|
||||
**First check if `ios/` and `android/` directories exist in the project.** If neither directory exists, the project uses Continuous Native Generation (CNG) and native projects are regenerated at build time — skip this section and "Clear caches for bare workflow" entirely.
|
||||
|
||||
If upgrading requires native changes:
|
||||
|
||||
```bash
|
||||
npx expo prebuild --clean
|
||||
```
|
||||
|
||||
This regenerates the `ios` and `android` directories. Ensure the project is not a bare workflow app before running this command.
|
||||
|
||||
## Clear caches for bare workflow
|
||||
|
||||
These steps only apply when `ios/` and/or `android/` directories exist in the project:
|
||||
|
||||
- Clear the cocoapods cache for iOS: `cd ios && pod install --repo-update`
|
||||
- Clear derived data for Xcode: `npx expo run:ios --no-build-cache`
|
||||
- Clear the Gradle cache for Android: `cd android && ./gradlew clean`
|
||||
|
||||
## Housekeeping
|
||||
|
||||
- Review release notes for the target SDK version at https://expo.dev/changelog
|
||||
- If using Expo SDK 54 or later, ensure react-native-worklets is installed — this is required for react-native-reanimated to work.
|
||||
- Enable React Compiler in SDK 54+ by adding `"experiments": { "reactCompiler": true }` to app.json — it's stable and recommended
|
||||
- Delete sdkVersion from `app.json` to let Expo manage it automatically
|
||||
- Remove implicit packages from `package.json`: `@babel/core`, `babel-preset-expo`, `expo-constants`.
|
||||
- If the babel.config.js only contains 'babel-preset-expo', delete the file
|
||||
- If the metro.config.js only contains expo defaults, delete the file
|
||||
|
||||
## Deprecated Packages
|
||||
|
||||
| Old Package | Replacement |
|
||||
| -------------------- | ---------------------------------------------------- |
|
||||
| `expo-av` | `expo-audio` and `expo-video` |
|
||||
| `expo-permissions` | Individual package permission APIs |
|
||||
| `@expo/vector-icons` | `expo-symbols` (for SF Symbols) |
|
||||
| `AsyncStorage` | `expo-sqlite/localStorage/install` |
|
||||
| `expo-app-loading` | `expo-splash-screen` |
|
||||
| expo-linear-gradient | experimental_backgroundImage + CSS gradients in View |
|
||||
|
||||
When migrating deprecated packages, update all code usage before removing the old package. For expo-av, consult the migration references to convert Audio.Sound to useAudioPlayer, Audio.Recording to useAudioRecorder, and Video components to VideoView with useVideoPlayer.
|
||||
|
||||
## expo.install.exclude
|
||||
|
||||
Check if package.json has excluded packages:
|
||||
|
||||
```json
|
||||
{
|
||||
"expo": { "install": { "exclude": ["react-native-reanimated"] } }
|
||||
}
|
||||
```
|
||||
|
||||
Exclusions are often workarounds that may no longer be needed after upgrading. Review each one.
|
||||
## Removing patches
|
||||
|
||||
Check if there are any outdated patches in the `patches/` directory. Remove them if they are no longer needed.
|
||||
|
||||
## Postcss
|
||||
|
||||
- `autoprefixer` isn't needed in SDK +53. Remove it from dependencies and check `postcss.config.js` or `postcss.config.mjs` to remove it from the plugins list.
|
||||
- Use `postcss.config.mjs` in SDK +53.
|
||||
|
||||
## Metro
|
||||
|
||||
Remove redundant metro config options:
|
||||
|
||||
- resolver.unstable_enablePackageExports is enabled by default in SDK +53.
|
||||
- `experimentalImportSupport` is enabled by default in SDK +54.
|
||||
- `EXPO_USE_FAST_RESOLVER=1` is removed in SDK +54.
|
||||
- cjs and mjs extensions are supported by default in SDK +50.
|
||||
- Expo webpack is deprecated, migrate to [Expo Router and Metro web](https://docs.expo.dev/router/migrate/from-expo-webpack/).
|
||||
|
||||
## Hermes engine v1
|
||||
|
||||
Since SDK 55, users can opt-in to use Hermes engine v1 for improved runtime performance. This requires setting `useHermesV1: true` in the `expo-build-properties` config plugin, and may require a specific version of the `hermes-compiler` npm package. Hermes v1 will become a default in some future SDK release.
|
||||
|
||||
## New Architecture
|
||||
|
||||
The new architecture is enabled by default, the app.json field `"newArchEnabled": true` is no longer needed as it's the default. Expo Go only supports the new architecture as of SDK +53.
|
||||
4
.agents/skills/upgrading-expo/agents/openai.yaml
Normal file
4
.agents/skills/upgrading-expo/agents/openai.yaml
Normal file
@@ -0,0 +1,4 @@
|
||||
interface:
|
||||
display_name: "Upgrading Expo"
|
||||
short_description: "Upgrade Expo SDKs, fix dependencies, adopt React 19 / React Compiler, and migrate deprecated Expo packages"
|
||||
default_prompt: "Use $upgrading-expo to upgrade an Expo SDK, run diagnostics, fix dependency conflicts, decide whether prebuild/cache clearing applies, and migrate away from deprecated Expo packages."
|
||||
132
.agents/skills/upgrading-expo/references/expo-av-to-audio.md
Normal file
132
.agents/skills/upgrading-expo/references/expo-av-to-audio.md
Normal file
@@ -0,0 +1,132 @@
|
||||
# Migrating from expo-av to expo-audio
|
||||
|
||||
## Imports
|
||||
|
||||
```tsx
|
||||
// Before
|
||||
import { Audio } from 'expo-av';
|
||||
|
||||
// After
|
||||
import { useAudioPlayer, useAudioRecorder, RecordingPresets, AudioModule, setAudioModeAsync } from 'expo-audio';
|
||||
```
|
||||
|
||||
## Audio Playback
|
||||
|
||||
### Before (expo-av)
|
||||
|
||||
```tsx
|
||||
const [sound, setSound] = useState<Audio.Sound>();
|
||||
|
||||
async function playSound() {
|
||||
const { sound } = await Audio.Sound.createAsync(require('./audio.mp3'));
|
||||
setSound(sound);
|
||||
await sound.playAsync();
|
||||
}
|
||||
|
||||
useEffect(() => {
|
||||
return sound ? () => { sound.unloadAsync(); } : undefined;
|
||||
}, [sound]);
|
||||
```
|
||||
|
||||
### After (expo-audio)
|
||||
|
||||
```tsx
|
||||
const player = useAudioPlayer(require('./audio.mp3'));
|
||||
|
||||
// Play
|
||||
player.play();
|
||||
```
|
||||
|
||||
## Audio Recording
|
||||
|
||||
### Before (expo-av)
|
||||
|
||||
```tsx
|
||||
const [recording, setRecording] = useState<Audio.Recording>();
|
||||
|
||||
async function startRecording() {
|
||||
await Audio.requestPermissionsAsync();
|
||||
await Audio.setAudioModeAsync({ allowsRecordingIOS: true, playsInSilentModeIOS: true });
|
||||
const { recording } = await Audio.Recording.createAsync(Audio.RecordingOptionsPresets.HIGH_QUALITY);
|
||||
setRecording(recording);
|
||||
}
|
||||
|
||||
async function stopRecording() {
|
||||
await recording?.stopAndUnloadAsync();
|
||||
const uri = recording?.getURI();
|
||||
}
|
||||
```
|
||||
|
||||
### After (expo-audio)
|
||||
|
||||
```tsx
|
||||
const recorder = useAudioRecorder(RecordingPresets.HIGH_QUALITY);
|
||||
|
||||
async function startRecording() {
|
||||
await AudioModule.requestRecordingPermissionsAsync();
|
||||
await recorder.prepareToRecordAsync();
|
||||
recorder.record();
|
||||
}
|
||||
|
||||
async function stopRecording() {
|
||||
await recorder.stop();
|
||||
const uri = recorder.uri;
|
||||
}
|
||||
```
|
||||
|
||||
## Audio Mode
|
||||
|
||||
### Before (expo-av)
|
||||
|
||||
```tsx
|
||||
await Audio.setAudioModeAsync({
|
||||
allowsRecordingIOS: true,
|
||||
playsInSilentModeIOS: true,
|
||||
staysActiveInBackground: true,
|
||||
interruptionModeIOS: InterruptionModeIOS.DoNotMix,
|
||||
});
|
||||
```
|
||||
|
||||
### After (expo-audio)
|
||||
|
||||
```tsx
|
||||
await setAudioModeAsync({
|
||||
playsInSilentMode: true,
|
||||
shouldPlayInBackground: true,
|
||||
interruptionMode: 'doNotMix',
|
||||
});
|
||||
```
|
||||
|
||||
## API Mapping
|
||||
|
||||
| expo-av | expo-audio |
|
||||
|---------|------------|
|
||||
| `Audio.Sound.createAsync()` | `useAudioPlayer(source)` |
|
||||
| `sound.playAsync()` | `player.play()` |
|
||||
| `sound.pauseAsync()` | `player.pause()` |
|
||||
| `sound.setPositionAsync(ms)` | `player.seekTo(seconds)` |
|
||||
| `sound.setVolumeAsync(vol)` | `player.volume = vol` |
|
||||
| `sound.setRateAsync(rate)` | `player.playbackRate = rate` |
|
||||
| `sound.setIsLoopingAsync(loop)` | `player.loop = loop` |
|
||||
| `sound.unloadAsync()` | Automatic via hook |
|
||||
| `playbackStatus.positionMillis` | `player.currentTime` (seconds) |
|
||||
| `playbackStatus.durationMillis` | `player.duration` (seconds) |
|
||||
| `playbackStatus.isPlaying` | `player.playing` |
|
||||
| `Audio.Recording.createAsync()` | `useAudioRecorder(preset)` |
|
||||
| `Audio.RecordingOptionsPresets.*` | `RecordingPresets.*` |
|
||||
| `recording.stopAndUnloadAsync()` | `recorder.stop()` |
|
||||
| `recording.getURI()` | `recorder.uri` |
|
||||
| `Audio.requestPermissionsAsync()` | `AudioModule.requestRecordingPermissionsAsync()` |
|
||||
|
||||
## Key Differences
|
||||
|
||||
- **No auto-reset on finish**: After `play()` completes, the player stays paused at the end. To replay, call `player.seekTo(0)` then `play()`
|
||||
- **Time in seconds**: expo-audio uses seconds, not milliseconds (matching web standards)
|
||||
- **Immediate loading**: Audio loads immediately when the hook mounts—no explicit preloading needed
|
||||
- **Automatic cleanup**: No need to call `unloadAsync()`, hooks handle resource cleanup on unmount
|
||||
- **Multiple players**: Create multiple `useAudioPlayer` instances and store them—all load immediately
|
||||
- **Direct property access**: Set volume, rate, loop directly on the player object (`player.volume = 0.5`)
|
||||
|
||||
## API Reference
|
||||
|
||||
https://docs.expo.dev/versions/latest/sdk/audio/
|
||||
160
.agents/skills/upgrading-expo/references/expo-av-to-video.md
Normal file
160
.agents/skills/upgrading-expo/references/expo-av-to-video.md
Normal file
@@ -0,0 +1,160 @@
|
||||
# Migrating from expo-av to expo-video
|
||||
|
||||
## Imports
|
||||
|
||||
```tsx
|
||||
// Before
|
||||
import { Video, ResizeMode } from 'expo-av';
|
||||
|
||||
// After
|
||||
import { useVideoPlayer, VideoView, VideoSource } from 'expo-video';
|
||||
import { useEvent, useEventListener } from 'expo';
|
||||
```
|
||||
|
||||
## Video Playback
|
||||
|
||||
### Before (expo-av)
|
||||
|
||||
```tsx
|
||||
const videoRef = useRef<Video>(null);
|
||||
const [status, setStatus] = useState({});
|
||||
|
||||
<Video
|
||||
ref={videoRef}
|
||||
source={{ uri: 'https://example.com/video.mp4' }}
|
||||
style={{ width: 350, height: 200 }}
|
||||
resizeMode={ResizeMode.CONTAIN}
|
||||
isLooping
|
||||
onPlaybackStatusUpdate={setStatus}
|
||||
/>
|
||||
|
||||
// Control
|
||||
videoRef.current?.playAsync();
|
||||
videoRef.current?.pauseAsync();
|
||||
```
|
||||
|
||||
### After (expo-video)
|
||||
|
||||
```tsx
|
||||
const player = useVideoPlayer('https://example.com/video.mp4', player => {
|
||||
player.loop = true;
|
||||
});
|
||||
|
||||
const { isPlaying } = useEvent(player, 'playingChange', { isPlaying: player.playing });
|
||||
|
||||
<VideoView
|
||||
player={player}
|
||||
style={{ width: 350, height: 200 }}
|
||||
contentFit="contain"
|
||||
/>
|
||||
|
||||
// Control
|
||||
player.play();
|
||||
player.pause();
|
||||
```
|
||||
|
||||
## Status Updates
|
||||
|
||||
### Before (expo-av)
|
||||
|
||||
```tsx
|
||||
<Video
|
||||
onPlaybackStatusUpdate={status => {
|
||||
if (status.isLoaded) {
|
||||
console.log(status.positionMillis, status.durationMillis, status.isPlaying);
|
||||
if (status.didJustFinish) console.log('finished');
|
||||
}
|
||||
}}
|
||||
/>
|
||||
```
|
||||
|
||||
### After (expo-video)
|
||||
|
||||
```tsx
|
||||
// Reactive state
|
||||
const { isPlaying } = useEvent(player, 'playingChange', { isPlaying: player.playing });
|
||||
|
||||
// Side effects
|
||||
useEventListener(player, 'playToEnd', () => console.log('finished'));
|
||||
|
||||
// Direct access
|
||||
console.log(player.currentTime, player.duration, player.playing);
|
||||
```
|
||||
|
||||
## Local Files
|
||||
|
||||
### Before (expo-av)
|
||||
|
||||
```tsx
|
||||
<Video source={require('./video.mp4')} />
|
||||
```
|
||||
|
||||
### After (expo-video)
|
||||
|
||||
```tsx
|
||||
const player = useVideoPlayer({ assetId: require('./video.mp4') });
|
||||
```
|
||||
|
||||
## Fullscreen and PiP
|
||||
|
||||
```tsx
|
||||
<VideoView
|
||||
player={player}
|
||||
allowsFullscreen
|
||||
allowsPictureInPicture
|
||||
onFullscreenEnter={() => {}}
|
||||
onFullscreenExit={() => {}}
|
||||
/>
|
||||
```
|
||||
|
||||
For PiP and background playback, add to app.json:
|
||||
|
||||
```json
|
||||
{
|
||||
"expo": {
|
||||
"plugins": [
|
||||
["expo-video", { "supportsBackgroundPlayback": true, "supportsPictureInPicture": true }]
|
||||
]
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
## API Mapping
|
||||
|
||||
| expo-av | expo-video |
|
||||
|---------|------------|
|
||||
| `<Video>` | `<VideoView>` |
|
||||
| `ref={videoRef}` | `player={useVideoPlayer()}` |
|
||||
| `source={{ uri }}` | Pass to `useVideoPlayer(uri)` |
|
||||
| `resizeMode={ResizeMode.CONTAIN}` | `contentFit="contain"` |
|
||||
| `isLooping` | `player.loop = true` |
|
||||
| `shouldPlay` | `player.play()` in setup |
|
||||
| `isMuted` | `player.muted = true` |
|
||||
| `useNativeControls` | `nativeControls={true}` |
|
||||
| `onPlaybackStatusUpdate` | `useEvent` / `useEventListener` |
|
||||
| `videoRef.current.playAsync()` | `player.play()` |
|
||||
| `videoRef.current.pauseAsync()` | `player.pause()` |
|
||||
| `videoRef.current.replayAsync()` | `player.replay()` |
|
||||
| `videoRef.current.setPositionAsync(ms)` | `player.currentTime = seconds` |
|
||||
| `status.positionMillis` | `player.currentTime` (seconds) |
|
||||
| `status.durationMillis` | `player.duration` (seconds) |
|
||||
| `status.didJustFinish` | `useEventListener(player, 'playToEnd')` |
|
||||
|
||||
## Key Differences
|
||||
|
||||
- **Separate player and view**: Player logic decoupled from the view—one player can be used across multiple views
|
||||
- **Time in seconds**: Uses seconds, not milliseconds
|
||||
- **Event system**: Uses `useEvent`/`useEventListener` from `expo` instead of callback props
|
||||
- **Video preloading**: Create a player without mounting a VideoView to preload for faster transitions
|
||||
- **Built-in caching**: Set `useCaching: true` in VideoSource for persistent offline caching
|
||||
|
||||
## Known Issues
|
||||
|
||||
- **Uninstall expo-av first**: On Android, having both expo-av and expo-video installed can cause VideoView to show a black screen. Uninstall expo-av before installing expo-video
|
||||
- **Android: Reusing players**: Mounting the same player in multiple VideoViews simultaneously can cause black screens on Android (works on iOS)
|
||||
- **Android: currentTime in setup**: Setting `player.currentTime` in the `useVideoPlayer` setup callback may not work on Android—set it after mount instead
|
||||
- **Changing source**: Use `player.replace(newSource)` to change videos without recreating the player
|
||||
|
||||
## API Reference
|
||||
|
||||
https://docs.expo.dev/versions/latest/sdk/video/
|
||||
124
.agents/skills/upgrading-expo/references/native-tabs.md
Normal file
124
.agents/skills/upgrading-expo/references/native-tabs.md
Normal file
@@ -0,0 +1,124 @@
|
||||
# Native Tabs Migration (SDK 55)
|
||||
|
||||
In SDK 55, `Label`, `Icon`, `Badge`, and `VectorIcon` are now accessed as static properties on `NativeTabs.Trigger` rather than separate imports.
|
||||
|
||||
## Import Changes
|
||||
|
||||
```tsx
|
||||
// SDK 53/54
|
||||
import {
|
||||
NativeTabs,
|
||||
Icon,
|
||||
Label,
|
||||
Badge,
|
||||
VectorIcon,
|
||||
} from "expo-router/unstable-native-tabs";
|
||||
|
||||
// SDK 55+
|
||||
import { NativeTabs } from "expo-router/unstable-native-tabs";
|
||||
```
|
||||
|
||||
## Component Changes
|
||||
|
||||
| SDK 53/54 | SDK 55+ |
|
||||
| ---------------- | ----------------------------------- |
|
||||
| `<Icon />` | `<NativeTabs.Trigger.Icon />` |
|
||||
| `<Label />` | `<NativeTabs.Trigger.Label />` |
|
||||
| `<Badge />` | `<NativeTabs.Trigger.Badge />` |
|
||||
| `<VectorIcon />` | `<NativeTabs.Trigger.VectorIcon />` |
|
||||
| (n/a) | `<NativeTabs.BottomAccessory />` |
|
||||
|
||||
## New in SDK 55
|
||||
|
||||
### BottomAccessory
|
||||
|
||||
New component for Apple Music-style mini players on iOS +26 that float above the tab bar:
|
||||
|
||||
```tsx
|
||||
<NativeTabs>
|
||||
<NativeTabs.BottomAccessory>
|
||||
{/* Content above tabs */}
|
||||
</NativeTabs.BottomAccessory>
|
||||
<NativeTabs.Trigger name="(index)">
|
||||
<NativeTabs.Trigger.Label>Home</NativeTabs.Trigger.Label>
|
||||
</NativeTabs.Trigger>
|
||||
</NativeTabs>
|
||||
```
|
||||
|
||||
On Android and web, this component will render as a no-op. Position a view absolutely above the tab bar instead.
|
||||
|
||||
### Icon `md` Prop
|
||||
|
||||
New `md` prop for Material icon glyphs on Android (alongside existing `drawable`):
|
||||
|
||||
```tsx
|
||||
<NativeTabs.Trigger.Icon sf="house" md="home" />
|
||||
```
|
||||
|
||||
## Full Migration Example
|
||||
|
||||
### Before (SDK 53/54)
|
||||
|
||||
```tsx
|
||||
import {
|
||||
NativeTabs,
|
||||
Icon,
|
||||
Label,
|
||||
Badge,
|
||||
} from "expo-router/unstable-native-tabs";
|
||||
|
||||
export default function TabLayout() {
|
||||
return (
|
||||
<NativeTabs minimizeBehavior="onScrollDown">
|
||||
<NativeTabs.Trigger name="(index)">
|
||||
<Label>Home</Label>
|
||||
<Icon sf="house.fill" />
|
||||
<Badge>3</Badge>
|
||||
</NativeTabs.Trigger>
|
||||
<NativeTabs.Trigger name="(settings)">
|
||||
<Label>Settings</Label>
|
||||
<Icon sf="gear" />
|
||||
</NativeTabs.Trigger>
|
||||
<NativeTabs.Trigger name="(search)" role="search">
|
||||
<Label>Search</Label>
|
||||
</NativeTabs.Trigger>
|
||||
</NativeTabs>
|
||||
);
|
||||
}
|
||||
```
|
||||
|
||||
### After (SDK 55+)
|
||||
|
||||
```tsx
|
||||
import { NativeTabs } from "expo-router/unstable-native-tabs";
|
||||
|
||||
export default function TabLayout() {
|
||||
return (
|
||||
<NativeTabs minimizeBehavior="onScrollDown">
|
||||
<NativeTabs.Trigger name="(index)">
|
||||
<NativeTabs.Trigger.Label>Home</NativeTabs.Trigger.Label>
|
||||
<NativeTabs.Trigger.Icon sf="house.fill" md="home" />
|
||||
<NativeTabs.Trigger.Badge>3</NativeTabs.Trigger.Badge>
|
||||
</NativeTabs.Trigger>
|
||||
<NativeTabs.Trigger name="(settings)">
|
||||
<NativeTabs.Trigger.Label>Settings</NativeTabs.Trigger.Label>
|
||||
<NativeTabs.Trigger.Icon sf="gear" md="settings" />
|
||||
</NativeTabs.Trigger>
|
||||
<NativeTabs.Trigger name="(search)" role="search">
|
||||
<NativeTabs.Trigger.Label>Search</NativeTabs.Trigger.Label>
|
||||
</NativeTabs.Trigger>
|
||||
</NativeTabs>
|
||||
);
|
||||
}
|
||||
```
|
||||
|
||||
## Migration Checklist
|
||||
|
||||
1. Remove `Icon`, `Label`, `Badge`, `VectorIcon` from imports
|
||||
2. Keep only `NativeTabs` import from `expo-router/unstable-native-tabs`
|
||||
3. Replace `<Icon />` with `<NativeTabs.Trigger.Icon />`
|
||||
4. Replace `<Label />` with `<NativeTabs.Trigger.Label />`
|
||||
5. Replace `<Badge />` with `<NativeTabs.Trigger.Badge />`
|
||||
6. Replace `<VectorIcon />` with `<NativeTabs.Trigger.VectorIcon />`
|
||||
|
||||
- Read docs for more info https://docs.expo.dev/versions/v55.0.0/sdk/router-native-tabs/
|
||||
79
.agents/skills/upgrading-expo/references/new-architecture.md
Normal file
79
.agents/skills/upgrading-expo/references/new-architecture.md
Normal file
@@ -0,0 +1,79 @@
|
||||
# New Architecture
|
||||
|
||||
The New Architecture is enabled by default in Expo SDK 53+. It replaces the legacy bridge with a faster, synchronous communication layer between JavaScript and native code.
|
||||
|
||||
## Documentation
|
||||
|
||||
Full guide: https://docs.expo.dev/guides/new-architecture/
|
||||
|
||||
## What Changed
|
||||
|
||||
- **JSI (JavaScript Interface)** — Direct synchronous calls between JS and native
|
||||
- **Fabric** — New rendering system with concurrent features
|
||||
- **TurboModules** — Lazy-loaded native modules with type safety
|
||||
|
||||
## SDK Compatibility
|
||||
|
||||
| SDK Version | New Architecture Status |
|
||||
| ----------- | ----------------------- |
|
||||
| SDK 53+ | Enabled by default |
|
||||
| SDK 52 | Opt-in via app.json |
|
||||
| SDK 51- | Experimental |
|
||||
|
||||
## Configuration
|
||||
|
||||
New Architecture is enabled by default. To explicitly disable (not recommended):
|
||||
|
||||
```json
|
||||
{
|
||||
"expo": {
|
||||
"newArchEnabled": false
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
## Expo Go
|
||||
|
||||
Expo Go only supports the New Architecture as of SDK 53. Apps using the old architecture must use development builds.
|
||||
|
||||
## Common Migration Issues
|
||||
|
||||
### Native Module Compatibility
|
||||
|
||||
Some older native modules may not support the New Architecture. Check:
|
||||
|
||||
1. Module documentation for New Architecture support
|
||||
2. GitHub issues for compatibility discussions
|
||||
3. Consider alternatives if module is unmaintained
|
||||
|
||||
### Reanimated
|
||||
|
||||
React Native Reanimated requires `react-native-worklets` in SDK 54+:
|
||||
|
||||
```bash
|
||||
npx expo install react-native-worklets
|
||||
```
|
||||
|
||||
### Layout Animations
|
||||
|
||||
Some layout animations behave differently. Test thoroughly after upgrading.
|
||||
|
||||
## Verifying New Architecture
|
||||
|
||||
Check if New Architecture is active:
|
||||
|
||||
```tsx
|
||||
import { Platform } from "react-native";
|
||||
|
||||
// Returns true if Fabric is enabled
|
||||
const isNewArch = global._IS_FABRIC !== undefined;
|
||||
```
|
||||
|
||||
Verify from the command line if the currently running app uses the New Architecture: `bunx xcobra expo eval "_IS_FABRIC"` -> `true`
|
||||
|
||||
## Troubleshooting
|
||||
|
||||
1. **Clear caches** — `npx expo start --clear`
|
||||
2. **Clean prebuild** — `npx expo prebuild --clean`
|
||||
3. **Check native modules** — Ensure all dependencies support New Architecture
|
||||
4. **Review console warnings** — Legacy modules log compatibility warnings
|
||||
79
.agents/skills/upgrading-expo/references/react-19.md
Normal file
79
.agents/skills/upgrading-expo/references/react-19.md
Normal file
@@ -0,0 +1,79 @@
|
||||
# React 19
|
||||
|
||||
React 19 is included in Expo SDK 54. This release simplifies several common patterns.
|
||||
|
||||
## Context Changes
|
||||
|
||||
### useContext → use
|
||||
|
||||
The `use` hook replaces `useContext`:
|
||||
|
||||
```tsx
|
||||
// Before (React 18)
|
||||
import { useContext } from "react";
|
||||
const value = useContext(MyContext);
|
||||
|
||||
// After (React 19)
|
||||
import { use } from "react";
|
||||
const value = use(MyContext);
|
||||
```
|
||||
|
||||
- The `use` hook can also read promises, enabling Suspense-based data fetching.
|
||||
- `use` can be called conditionally, this simplifies components that consume multiple contexts.
|
||||
|
||||
### Context.Provider → Context
|
||||
|
||||
Context providers no longer need the `.Provider` suffix:
|
||||
|
||||
```tsx
|
||||
// Before (React 18)
|
||||
<ThemeContext.Provider value={theme}>
|
||||
{children}
|
||||
</ThemeContext.Provider>
|
||||
|
||||
// After (React 19)
|
||||
<ThemeContext value={theme}>
|
||||
{children}
|
||||
</ThemeContext>
|
||||
```
|
||||
|
||||
## ref as a Prop
|
||||
|
||||
### Removing forwardRef
|
||||
|
||||
Components can now receive `ref` as a regular prop. `forwardRef` is no longer needed:
|
||||
|
||||
```tsx
|
||||
// Before (React 18)
|
||||
import { forwardRef } from "react";
|
||||
|
||||
const Input = forwardRef<TextInput, Props>((props, ref) => {
|
||||
return <TextInput ref={ref} {...props} />;
|
||||
});
|
||||
|
||||
// After (React 19)
|
||||
function Input({ ref, ...props }: Props & { ref?: React.Ref<TextInput> }) {
|
||||
return <TextInput ref={ref} {...props} />;
|
||||
}
|
||||
```
|
||||
|
||||
### Migration Steps
|
||||
|
||||
1. Remove `forwardRef` wrapper
|
||||
2. Add `ref` to the props destructuring
|
||||
3. Update the type to include `ref?: React.Ref<T>`
|
||||
|
||||
## Other React 19 Features
|
||||
|
||||
- **Actions** — Functions that handle async transitions
|
||||
- **useOptimistic** — Optimistic UI updates
|
||||
- **useFormStatus** — Form submission state (web)
|
||||
- **Document Metadata** — Native `<title>` and `<meta>` support (web)
|
||||
|
||||
## Cleanup Checklist
|
||||
|
||||
When upgrading to SDK 54:
|
||||
|
||||
- [ ] Replace `useContext` with `use`
|
||||
- [ ] Remove `.Provider` from Context components
|
||||
- [ ] Remove `forwardRef` wrappers, use `ref` prop instead
|
||||
59
.agents/skills/upgrading-expo/references/react-compiler.md
Normal file
59
.agents/skills/upgrading-expo/references/react-compiler.md
Normal file
@@ -0,0 +1,59 @@
|
||||
# React Compiler
|
||||
|
||||
React Compiler is stable in Expo SDK 54 and later. It automatically memoizes components and hooks, eliminating the need for manual `useMemo`, `useCallback`, and `React.memo`.
|
||||
|
||||
## Enabling React Compiler
|
||||
|
||||
Add to `app.json`:
|
||||
|
||||
```json
|
||||
{
|
||||
"expo": {
|
||||
"experiments": {
|
||||
"reactCompiler": true
|
||||
}
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
## What React Compiler Does
|
||||
|
||||
- Automatically memoizes components and values
|
||||
- Eliminates unnecessary re-renders
|
||||
- Removes the need for manual `useMemo` and `useCallback`
|
||||
- Works with existing code without modifications
|
||||
|
||||
## Cleanup After Enabling
|
||||
|
||||
Once React Compiler is enabled, you can remove manual memoization:
|
||||
|
||||
```tsx
|
||||
// Before (manual memoization)
|
||||
const memoizedValue = useMemo(() => computeExpensive(a, b), [a, b]);
|
||||
const memoizedCallback = useCallback(() => doSomething(a), [a]);
|
||||
const MemoizedComponent = React.memo(MyComponent);
|
||||
|
||||
// After (React Compiler handles it)
|
||||
const value = computeExpensive(a, b);
|
||||
const callback = () => doSomething(a);
|
||||
// Just use MyComponent directly
|
||||
```
|
||||
|
||||
## Requirements
|
||||
|
||||
- Expo SDK 54 or later
|
||||
- New Architecture enabled (default in SDK 54+)
|
||||
|
||||
## Verifying It's Working
|
||||
|
||||
React Compiler runs at build time. Check the Metro bundler output for compilation messages. You can also use React DevTools to verify components are being optimized.
|
||||
|
||||
## Troubleshooting
|
||||
|
||||
If you encounter issues:
|
||||
|
||||
1. Ensure New Architecture is enabled
|
||||
2. Clear Metro cache: `npx expo start --clear`
|
||||
3. Check for incompatible patterns in your code (rare)
|
||||
|
||||
React Compiler is designed to work with idiomatic React code. If it can't safely optimize a component, it skips that component without breaking your app.
|
||||
@@ -0,0 +1,61 @@
|
||||
# Migrating from react-navigation to expo-router
|
||||
|
||||
In SDK 56+, application code must not import from `@react-navigation/*` directly. Repoint those imports to the matching `expo-router` entry points. Runtime API is unchanged — only the module specifiers move.
|
||||
|
||||
## Steps
|
||||
|
||||
1. Prefer the automated codemod (see below). If it is not viable, fall back to the manual mapping.
|
||||
2. Replace imports using the table. Use the entry point that matches the `@react-navigation/*` source.
|
||||
3. After rewriting, check whether any of the rewritten imports are deprecated in `expo-router` (see [Check for deprecated imports](#check-for-deprecated-imports)). If so, surface the deprecation reason and the suggested replacement to the user before continuing.
|
||||
4. Validate: search for remaining `@react-navigation/` references in source files, then run typecheck/build/start.
|
||||
5. Remove `@react-navigation/*` packages that are no longer imported from `package.json` and reinstall (delete `node_modules` if needed).
|
||||
|
||||
## Automated migration (preferred)
|
||||
|
||||
Run from the project root over your application code (replace `src` with the actual directory or glob):
|
||||
|
||||
```sh
|
||||
npx expo-codemod sdk-56-expo-router-react-navigation-replace src
|
||||
```
|
||||
|
||||
```sh
|
||||
npx expo-codemod sdk-56-expo-router-react-navigation-replace '**/*.{ts,tsx,js,jsx}'
|
||||
```
|
||||
|
||||
## Manual API mapping
|
||||
|
||||
| React Navigation source | Expo Router target |
|
||||
| ------------------------------------- | ------------------------------------------------------------------------ |
|
||||
| `@react-navigation/native` | `expo-router/react-navigation` |
|
||||
| `@react-navigation/core` | `expo-router/react-navigation` |
|
||||
| `@react-navigation/elements` | `expo-router/react-navigation` |
|
||||
| `@react-navigation/routers` | `expo-router/react-navigation` |
|
||||
| `@react-navigation/stack` | `expo-router/js-stack` |
|
||||
| `@react-navigation/bottom-tabs` | `expo-router/js-tabs` |
|
||||
| `@react-navigation/material-top-tabs` | `expo-router/js-top-tabs` |
|
||||
| `@react-navigation/native-stack` | No direct equivalent. Use the `Stack` layout from `expo-router` instead. |
|
||||
|
||||
**Stack caveat:** Do NOT rewrite `import { Stack } from "expo-router"` to `expo-router/js-stack`. The root `Stack` is the Expo Router layout component used in route files; only use `expo-router/js-stack` when replacing a `@react-navigation/stack` JS stack navigator.
|
||||
|
||||
If you encounter a symbol that has no replacement, ask the user to file an issue in the `expo/expo` repository describing what is needed and why.
|
||||
|
||||
## Check for deprecated imports
|
||||
|
||||
A successful rewrite to `expo-router/*` does not guarantee the new import is the recommended one. Some symbols are re-exported as deprecated shims and the project may need to migrate further (for example, to a different `expo-router` API or to a first-party Expo package).
|
||||
|
||||
For each symbol rewritten in step 2:
|
||||
|
||||
1. Resolve the rewritten module to its source in `node_modules` (e.g., `node_modules/expo-router/build/react-navigation.d.ts`, `js-stack`, `js-tabs`, `js-top-tabs`).
|
||||
2. Look for a `@deprecated` JSDoc tag on the named export, or a runtime deprecation warning in the implementation file.
|
||||
3. If deprecated, capture both the reason and the recommended replacement from the JSDoc/comment.
|
||||
4. Report each deprecated symbol to the user with: the import path, the symbol, the deprecation reason, and the suggested replacement. Wait for the user to confirm before mass-applying further changes.
|
||||
|
||||
## Done when
|
||||
|
||||
1. No `@react-navigation/*` imports remain in source files.
|
||||
2. No unused `@react-navigation/*` entries remain in `package.json`.
|
||||
3. Typecheck and bundler start without `@react-navigation/*` errors.
|
||||
|
||||
## Reference
|
||||
|
||||
- Official Expo Router SDK 55 → 56 migration guide: https://docs.expo.dev/router/migrate/sdk-55-to-56
|
||||
19
.nvim.lua
Normal file
19
.nvim.lua
Normal file
@@ -0,0 +1,19 @@
|
||||
local ok, conform = pcall(require, "conform")
|
||||
if not ok then
|
||||
vim.notify("conform.nvim not loaded", vim.log.levels.WARN)
|
||||
return
|
||||
end
|
||||
|
||||
conform.setup({
|
||||
formatters_by_ft = {
|
||||
javascript = { "oxfmt" },
|
||||
javascriptreact = { "oxfmt" },
|
||||
typescript = { "oxfmt" },
|
||||
typescriptreact = { "oxfmt" },
|
||||
json = { "oxfmt" },
|
||||
jsonc = { "oxfmt" },
|
||||
},
|
||||
})
|
||||
|
||||
vim.lsp.enable("tsgo")
|
||||
vim.lsp.enable("oxlint")
|
||||
20
.zed/settings.json
Normal file
20
.zed/settings.json
Normal file
@@ -0,0 +1,20 @@
|
||||
// Folder-specific settings
|
||||
//
|
||||
// For a full list of overridable settings, and general information on folder-specific settings,
|
||||
// see the documentation: https://zed.dev/docs/configuring-zed#settings-files
|
||||
{
|
||||
"languages": {
|
||||
"TypeScript": {
|
||||
"formatter": { "language_server": { "name": "oxfmt" } }
|
||||
},
|
||||
"TSX": {
|
||||
"formatter": { "language_server": { "name": "oxfmt" } }
|
||||
},
|
||||
"JavaScript": {
|
||||
"formatter": { "language_server": { "name": "oxfmt" } }
|
||||
},
|
||||
"JSX": {
|
||||
"formatter": { "language_server": { "name": "oxfmt" } }
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -21,8 +21,8 @@
|
||||
"lucide-react": "^0.577.0",
|
||||
"next-themes": "^0.4.6",
|
||||
"radix-ui": "^1.4.3",
|
||||
"react": "^19.2.0",
|
||||
"react-dom": "^19.2.0",
|
||||
"react": "19.2.3",
|
||||
"react-dom": "19.2.3",
|
||||
"shadcn": "^4.0.8",
|
||||
"sonner": "^2.0.7",
|
||||
"tailwind-merge": "^3.5.0",
|
||||
|
||||
@@ -10,6 +10,6 @@
|
||||
},
|
||||
"dependencies": {
|
||||
"@freya/agent-protocol": "workspace:*",
|
||||
"@nym.sh/jrpc": "^0.1.0"
|
||||
"@nym.sh/jrpc": "1.1.0"
|
||||
}
|
||||
}
|
||||
|
||||
@@ -26,7 +26,7 @@
|
||||
"@freya/source-tfl": "workspace:*",
|
||||
"@freya/source-weatherkit": "workspace:*",
|
||||
"@freya/source-web-search": "workspace:*",
|
||||
"@nym.sh/jrpc": "^0.1.0",
|
||||
"@nym.sh/jrpc": "1.1.0",
|
||||
"@openrouter/sdk": "^0.9.11",
|
||||
"arktype": "^2.1.29",
|
||||
"better-auth": "^1",
|
||||
|
||||
@@ -44,7 +44,7 @@ mock.module("../sources/user-sources.ts", () => ({
|
||||
}),
|
||||
}))
|
||||
|
||||
mock.module("../conversations/storage.ts", () => ({
|
||||
mock.module("../conversations/db-storage.ts", () => ({
|
||||
conversations: (_db: Database, userId: string) => ({
|
||||
async getOrCreateConversation() {
|
||||
return { id: `conversation-${userId}` }
|
||||
|
||||
@@ -1,3 +1,4 @@
|
||||
import { ConversationEntryKind } from "@freya/core"
|
||||
import { describe, expect, test } from "bun:test"
|
||||
|
||||
import type { AppendConversationEntryInput } from "../conversations/storage.ts"
|
||||
@@ -6,7 +7,6 @@ import type {
|
||||
ConversationStorageEntry,
|
||||
} from "./conversation-recording-query-agent.ts"
|
||||
|
||||
import { ConversationEntryKind } from "../conversations/types.ts"
|
||||
import { ConversationRecordingQueryAgent } from "./conversation-recording-query-agent.ts"
|
||||
import {
|
||||
createQueryAgentEventListeners,
|
||||
|
||||
@@ -1,12 +1,13 @@
|
||||
import type { ConversationEntryMetadata } from "@freya/core"
|
||||
|
||||
import { ConversationEntryKind } from "@freya/core"
|
||||
import { randomUUID } from "node:crypto"
|
||||
|
||||
import type {
|
||||
AppendConversationEntryInput,
|
||||
ConversationEntryRow,
|
||||
} from "../conversations/storage.ts"
|
||||
import type { ConversationEntryMetadata } from "../conversations/types.ts"
|
||||
|
||||
import { ConversationEntryKind } from "../conversations/types.ts"
|
||||
import {
|
||||
createQueryAgentEventListeners,
|
||||
QueryAgentEvent,
|
||||
@@ -19,6 +20,7 @@ import {
|
||||
type QueryAgentStreamEvent,
|
||||
} from "./query-agent.ts"
|
||||
|
||||
/** Storage operations used to persist and replay query-agent conversation entries. */
|
||||
export interface ConversationStorage {
|
||||
getOrCreateConversation(): Promise<{ id: string }>
|
||||
appendEntry(
|
||||
@@ -28,11 +30,13 @@ export interface ConversationStorage {
|
||||
listEntries(conversationId: string): Promise<ConversationStorageEntry[]>
|
||||
}
|
||||
|
||||
/** Minimal persisted entry shape needed by recording and replay agents. */
|
||||
export type ConversationStorageEntry = Pick<
|
||||
ConversationEntryRow,
|
||||
"id" | "sequence" | "kind" | "payload" | "metadata" | "createdAt"
|
||||
>
|
||||
|
||||
/** Configuration for wrapping a QueryAgent with conversation recording. */
|
||||
export interface ConversationRecordingQueryAgentConfig {
|
||||
agent: QueryAgent
|
||||
storage: ConversationStorage
|
||||
|
||||
145
apps/freya-backend/src/agent/job.ts
Normal file
145
apps/freya-backend/src/agent/job.ts
Normal file
@@ -0,0 +1,145 @@
|
||||
import type { AgentEvent } from "@freya/agent-protocol"
|
||||
|
||||
import {
|
||||
AssistantMessagePayload,
|
||||
ConversationEntryKind,
|
||||
UserMessagePayload,
|
||||
ToolCallPayload,
|
||||
ToolResultPayload,
|
||||
} from "@freya/core"
|
||||
import { type } from "arktype"
|
||||
|
||||
import type { ConversationStorage } from "../conversations/storage"
|
||||
import type { Job } from "../lib/job"
|
||||
import type { JobExecutor } from "../lib/worker"
|
||||
import type { NotificationCentral } from "../notification/notification-central"
|
||||
import type { UserSessionManager } from "../session"
|
||||
|
||||
import { ConversationResponseStateStatus } from "../db/schema"
|
||||
import { streamAgentResponse } from "./streaming"
|
||||
|
||||
export interface AgentResponseJobPayload {
|
||||
conversationId: string
|
||||
}
|
||||
|
||||
interface AgentResponseWorkerConfig {
|
||||
conversationStorage: ConversationStorage
|
||||
userSessionManager: UserSessionManager
|
||||
notificationCentral: NotificationCentral
|
||||
}
|
||||
|
||||
export class AgentResponseJobExecutor implements JobExecutor<AgentResponseJobPayload> {
|
||||
private conversationStorage: ConversationStorage
|
||||
private userSessionManager: UserSessionManager
|
||||
private notificationCentral: NotificationCentral
|
||||
|
||||
constructor({
|
||||
conversationStorage,
|
||||
userSessionManager,
|
||||
notificationCentral,
|
||||
}: AgentResponseWorkerConfig) {
|
||||
this.conversationStorage = conversationStorage
|
||||
this.userSessionManager = userSessionManager
|
||||
this.notificationCentral = notificationCentral
|
||||
}
|
||||
|
||||
async execute(job: Job<AgentResponseJobPayload>): Promise<void> {
|
||||
const conversation = await this.conversationStorage.findConversation(job.payload.conversationId)
|
||||
if (!conversation) {
|
||||
return
|
||||
}
|
||||
|
||||
const claimed = await this.conversationStorage.claimPendingConversationResponseState(
|
||||
job.payload.conversationId,
|
||||
)
|
||||
if (!claimed) {
|
||||
// conversation response state not found or already claimed
|
||||
return
|
||||
}
|
||||
|
||||
const pendingEntries = await this.conversationStorage.listPendingUserConversationEntries(
|
||||
conversation.userId,
|
||||
conversation.id,
|
||||
)
|
||||
if (pendingEntries.length === 0) {
|
||||
await this.conversationStorage.clearConversationResponseState(job.payload.conversationId)
|
||||
return
|
||||
}
|
||||
|
||||
const message = pendingEntries.reduce((acc, entry) => {
|
||||
const payload = UserMessagePayload(entry.payload)
|
||||
if (payload instanceof type.errors) {
|
||||
return acc
|
||||
}
|
||||
return (
|
||||
acc + "\n" + payload.parts.reduce((msg, p) => (p.type === "text" ? msg + p.text : msg), "")
|
||||
)
|
||||
}, "")
|
||||
|
||||
const session = await this.userSessionManager.getOrCreate(conversation.userId)
|
||||
|
||||
try {
|
||||
for await (const event of streamAgentResponse({
|
||||
agent: session.agent,
|
||||
input: { message, signal: job.signal },
|
||||
})) {
|
||||
if (job.signal.aborted) {
|
||||
break
|
||||
}
|
||||
|
||||
await this.recordAgentEvent(event, conversation.id)
|
||||
await this.notificationCentral.notifyUser(conversation.userId, {
|
||||
kind: "agent",
|
||||
payload: event,
|
||||
})
|
||||
}
|
||||
|
||||
// if job is aborted, stop everything immediately, including clean up.
|
||||
// the aborter is assumed responsibility on how to proceed.
|
||||
if (!job.signal.aborted) {
|
||||
await this.conversationStorage.clearConversationResponseState(job.payload.conversationId)
|
||||
}
|
||||
} catch (err) {
|
||||
console.error("[agent job executor] error streaming agent response:", err)
|
||||
if (!job.signal.aborted) {
|
||||
await this.conversationStorage.markResponseStateStatus(
|
||||
[job.payload.conversationId],
|
||||
ConversationResponseStateStatus.Failed,
|
||||
)
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
private async recordAgentEvent(event: AgentEvent, conversationId: string) {
|
||||
switch (event.type) {
|
||||
case "message_created":
|
||||
await this.conversationStorage.appendEntry(conversationId, {
|
||||
kind: ConversationEntryKind.AssistantMessage,
|
||||
payload: {
|
||||
role: "assistant",
|
||||
parts: [{ type: "text", text: event.text }],
|
||||
} satisfies AssistantMessagePayload,
|
||||
})
|
||||
break
|
||||
|
||||
case "tool_started":
|
||||
await this.conversationStorage.appendEntry(conversationId, {
|
||||
kind: ConversationEntryKind.ToolCall,
|
||||
payload: {
|
||||
toolName: event.toolName,
|
||||
} satisfies ToolCallPayload,
|
||||
})
|
||||
break
|
||||
|
||||
case "tool_finished":
|
||||
await this.conversationStorage.appendEntry(conversationId, {
|
||||
kind: ConversationEntryKind.ToolResult,
|
||||
payload: {
|
||||
toolName: event.toolName,
|
||||
ok: event.ok,
|
||||
} satisfies ToolResultPayload,
|
||||
})
|
||||
break
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -1,9 +1,9 @@
|
||||
import { ConversationEntryKind } from "@freya/core"
|
||||
import { beforeEach, describe, expect, mock, test } from "bun:test"
|
||||
|
||||
import type { QueryAgentToolbox } from "./query-agent-toolbox.ts"
|
||||
import type { QueryAgentStreamEvent } from "./query-agent.ts"
|
||||
|
||||
import { ConversationEntryKind } from "../conversations/types.ts"
|
||||
import { QueryAgentEvent } from "./query-agent.ts"
|
||||
|
||||
interface FakePiSession {
|
||||
|
||||
@@ -33,13 +33,25 @@ import {
|
||||
import { createSessionManager } from "./session-manager.ts"
|
||||
import { createFreyaAgentTools, FREYA_AGENT_TOOL_NAMES } from "./tools.ts"
|
||||
|
||||
/** Active Pi SDK session instance returned by createAgentSession. */
|
||||
type PiSession = Awaited<ReturnType<typeof createAgentSession>>["session"]
|
||||
|
||||
/** Pi event emitted when a message finishes. */
|
||||
type PiMessageEndEvent = Extract<AgentSessionEvent, { type: "message_end" }>
|
||||
|
||||
/** Message payload carried by Pi's message-end event. */
|
||||
type PiAgentMessage = PiMessageEndEvent["message"]
|
||||
|
||||
/** Pi event emitted when an agent run finishes. */
|
||||
type PiAgentEndEvent = Extract<AgentSessionEvent, { type: "agent_end" }>
|
||||
|
||||
/** Session manager created for Pi conversation replay. */
|
||||
type PiSessionManager = ReturnType<typeof createSessionManager>
|
||||
|
||||
/** Message shape accepted by the replay session manager. */
|
||||
type PiSessionMessage = Parameters<PiSessionManager["appendMessage"]>[0]
|
||||
|
||||
/** Configuration for the Pi-backed query agent. */
|
||||
export interface PiQueryAgentConfig {
|
||||
toolbox: QueryAgentToolbox
|
||||
apiKey?: string
|
||||
@@ -154,6 +166,16 @@ export class PiQueryAgent implements QueryAgent {
|
||||
this.handlePiEvent(event, pushRunEvent)
|
||||
})
|
||||
|
||||
input.signal?.addEventListener(
|
||||
"abort",
|
||||
async () => {
|
||||
await session.abort()
|
||||
close()
|
||||
unsubscribe()
|
||||
},
|
||||
{ once: true },
|
||||
)
|
||||
|
||||
session
|
||||
.prompt(input.message)
|
||||
.then(() => {
|
||||
|
||||
@@ -2,6 +2,7 @@ export interface QueryAgentAsk {
|
||||
message: string
|
||||
conversationId?: string
|
||||
userMessageEntry?: QueryAgentConversationEntryRef
|
||||
signal?: AbortSignal
|
||||
}
|
||||
|
||||
export type QueryAgentStreamEvent =
|
||||
|
||||
70
apps/freya-backend/src/agent/reconciler.ts
Normal file
70
apps/freya-backend/src/agent/reconciler.ts
Normal file
@@ -0,0 +1,70 @@
|
||||
import type { ConversationStorage } from "../conversations/storage"
|
||||
import type { AgentWorkScheduler } from "./scheduler"
|
||||
|
||||
interface AgentResponseReconcilerConfig {
|
||||
storage: ConversationStorage
|
||||
interval: number
|
||||
scheduler: AgentWorkScheduler
|
||||
signal: AbortSignal
|
||||
}
|
||||
|
||||
export class AgentResponseReconciler {
|
||||
private storage: ConversationStorage
|
||||
private interval: number
|
||||
private scheduler: AgentWorkScheduler
|
||||
private signal: AbortSignal
|
||||
|
||||
private stopLoop: ReturnType<typeof setInterval> | null = null
|
||||
|
||||
constructor({ storage, interval, scheduler, signal }: AgentResponseReconcilerConfig) {
|
||||
this.storage = storage
|
||||
this.interval = interval
|
||||
this.scheduler = scheduler
|
||||
this.signal = signal
|
||||
}
|
||||
|
||||
start() {
|
||||
this.signal.throwIfAborted()
|
||||
|
||||
this.signal.addEventListener(
|
||||
"abort",
|
||||
() => {
|
||||
if (this.stopLoop !== null) {
|
||||
clearInterval(this.stopLoop)
|
||||
this.stopLoop = null
|
||||
}
|
||||
},
|
||||
{ once: true },
|
||||
)
|
||||
|
||||
this.stopLoop = setInterval(this.reconcile.bind(this), this.interval)
|
||||
}
|
||||
|
||||
private async reconcile() {
|
||||
// enqueue pending responses
|
||||
const pendingStates = await this.storage.listPendingResponseStates()
|
||||
const now = new Date().getTime()
|
||||
for (const state of pendingStates) {
|
||||
if (state.maxWaitUntil.getTime() < now) {
|
||||
this.scheduler.enqueueAgentResponse(state.conversationId)
|
||||
}
|
||||
}
|
||||
|
||||
// re-enqueue stuck responses
|
||||
const runningStates = await this.storage.listRunningResponseStates()
|
||||
const stuckIds: string[] = []
|
||||
for (const state of runningStates) {
|
||||
if (state.runningSince && Math.max(now - state.runningSince.getTime(), 0) > 5 * 1000 * 60) {
|
||||
// if the response is running for more than 5 minutes
|
||||
// we assume that its stuck and enqueue it for retry
|
||||
stuckIds.push(state.conversationId)
|
||||
}
|
||||
}
|
||||
if (stuckIds.length > 0) {
|
||||
await this.storage.markResponseStateStatus(stuckIds, "pending")
|
||||
for (const id of stuckIds) {
|
||||
this.scheduler.enqueueAgentResponse(id)
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
160
apps/freya-backend/src/agent/scheduler.ts
Normal file
160
apps/freya-backend/src/agent/scheduler.ts
Normal file
@@ -0,0 +1,160 @@
|
||||
import type { UserEvent } from "@freya/agent-protocol"
|
||||
|
||||
import { ConversationEntryKind, UserMessagePayload } from "@freya/core"
|
||||
|
||||
import type { ConversationStorage } from "../conversations/storage"
|
||||
import type { Job, JobRegistry } from "../lib/job"
|
||||
import type { AgentResponseJobPayload } from "./job"
|
||||
import { ConversationNotFoundError } from "../conversations/errors";
|
||||
import { ConversationResponseStateStatus } from "../db/schema";
|
||||
|
||||
interface AgentMessageSchedulerConfig {
|
||||
storage: ConversationStorage
|
||||
maxWaitTime: number
|
||||
|
||||
/**
|
||||
* How long to wait before responding to the user.
|
||||
*/
|
||||
waitTIme: number
|
||||
|
||||
jobRegistry: JobRegistry<AgentResponseJobPayload>
|
||||
}
|
||||
|
||||
/**
|
||||
* Schedules and manages the flow of messages between the user and the query agent for a specific conversation.
|
||||
*/
|
||||
export class AgentWorkScheduler {
|
||||
private conversationStorage: ConversationStorage
|
||||
private jobRegistry: JobRegistry<AgentResponseJobPayload>
|
||||
|
||||
private timing: {
|
||||
maxWaitTime: number
|
||||
waitTime: number
|
||||
}
|
||||
|
||||
private timers = new Map<string, ReturnType<typeof setTimeout>>()
|
||||
private runningJobs = new Map<string, Job<AgentResponseJobPayload>>()
|
||||
|
||||
constructor(config: AgentMessageSchedulerConfig) {
|
||||
this.conversationStorage = config.storage
|
||||
this.jobRegistry = config.jobRegistry
|
||||
this.timing = {
|
||||
maxWaitTime: config.maxWaitTime,
|
||||
waitTime: config.waitTIme,
|
||||
}
|
||||
|
||||
this.jobRegistry.addEventListener("settled", this.eraseJob.bind(this))
|
||||
this.jobRegistry.addEventListener("cancelled", this.eraseJob.bind(this))
|
||||
}
|
||||
|
||||
async receiveMessage(conversationId: string, message: string) {
|
||||
await this.conversationStorage.transaction(async (storage) => {
|
||||
const now = new Date()
|
||||
|
||||
const entry = await storage.appendEntry(conversationId, {
|
||||
kind: ConversationEntryKind.UserMessage,
|
||||
payload: {
|
||||
role: "user",
|
||||
parts: [{ type: "text", text: message }],
|
||||
} satisfies UserMessagePayload,
|
||||
})
|
||||
|
||||
await storage.upsertConversationResponseState(conversationId, {
|
||||
maxWaitUntil: new Date(now.getTime() + this.timing.maxWaitTime),
|
||||
pendingSinceEntryId: entry.id,
|
||||
status: "pending",
|
||||
})
|
||||
|
||||
return entry
|
||||
})
|
||||
this.scheduleAgentResponse(conversationId, this.timing.waitTime)
|
||||
}
|
||||
|
||||
async receiveUserEvent(conversationId: string, event: UserEvent) {
|
||||
if (event.type === "typing") {
|
||||
await this.delayAgentResponse(conversationId)
|
||||
}
|
||||
}
|
||||
|
||||
enqueueAgentResponse(conversationId: string): void {
|
||||
const existing = this.timers.get(conversationId)
|
||||
if (existing) {
|
||||
clearTimeout(existing)
|
||||
this.timers.delete(conversationId)
|
||||
}
|
||||
|
||||
this.cancelCurrentJob(conversationId)
|
||||
|
||||
const job = this.jobRegistry.addJob({
|
||||
payload: { conversationId },
|
||||
})
|
||||
this.runningJobs.set(conversationId, job)
|
||||
}
|
||||
|
||||
private async delayAgentResponse(conversationId: string) {
|
||||
this.cancelCurrentJob(conversationId);
|
||||
|
||||
try {
|
||||
const ok = await this.conversationStorage.transaction(async (storage) => {
|
||||
const state = await storage.findConversationResponseState(conversationId);
|
||||
if (state && state.status !== ConversationResponseStateStatus.Failed) {
|
||||
await storage.updateConversationResponseState(conversationId, {
|
||||
status: ConversationResponseStateStatus.Pending,
|
||||
// the agent response was cancelled, so its no longer running
|
||||
// clear runningSince timestamp
|
||||
runningSince: null,
|
||||
})
|
||||
return true
|
||||
}
|
||||
return false
|
||||
})
|
||||
if (ok) {
|
||||
await this.scheduleAgentResponse(conversationId, this.timing.waitTime)
|
||||
}
|
||||
} catch (error) {
|
||||
if (error instanceof ConversationNotFoundError) {
|
||||
// the user is typing but there isn't a scheduled agent response yet
|
||||
// which means the user is typing their first message after the agent has previously responded
|
||||
// swallow the error
|
||||
} else {
|
||||
console.error("[agent response scheduler] error delaying agent response", error)
|
||||
}
|
||||
return
|
||||
}
|
||||
}
|
||||
|
||||
private async scheduleAgentResponse(conversationId: string, delay: number) {
|
||||
const existing = this.timers.get(conversationId)
|
||||
if (existing) {
|
||||
clearTimeout(existing)
|
||||
}
|
||||
|
||||
this.cancelCurrentJob(conversationId)
|
||||
|
||||
this.timers.set(
|
||||
conversationId,
|
||||
setTimeout(() => {
|
||||
this.enqueueAgentResponse(conversationId)
|
||||
}, delay),
|
||||
)
|
||||
}
|
||||
|
||||
/**
|
||||
* cancels the current job for agent response for the given conversation id
|
||||
* no-op if there is no active job for the conversation.
|
||||
*/
|
||||
private cancelCurrentJob(conversationId: string): void {
|
||||
const job = this.runningJobs.get(conversationId)
|
||||
if (!job) return
|
||||
|
||||
// If an active response is working on stale context, abort it so the next
|
||||
// job can answer using the latest pending user messages.
|
||||
this.jobRegistry.cancelJob(job)
|
||||
}
|
||||
|
||||
private eraseJob(job: Job<AgentResponseJobPayload>) {
|
||||
if (this.runningJobs.get(job.payload.conversationId) === job) {
|
||||
this.runningJobs.delete(job.payload.conversationId)
|
||||
}
|
||||
}
|
||||
}
|
||||
66
apps/freya-backend/src/agent/service.ts
Normal file
66
apps/freya-backend/src/agent/service.ts
Normal file
@@ -0,0 +1,66 @@
|
||||
import type { UserEvent } from "@freya/agent-protocol"
|
||||
|
||||
import type { ConversationStorage } from "../conversations/storage"
|
||||
import type { NotificationCentral } from "../notification/notification-central"
|
||||
import type { UserSessionManager } from "../session"
|
||||
|
||||
import { JobRegistry } from "../lib/job"
|
||||
import { Worker } from "../lib/worker"
|
||||
import { AgentResponseJobExecutor, type AgentResponseJobPayload } from "./job"
|
||||
import { AgentResponseReconciler } from "./reconciler"
|
||||
import { AgentWorkScheduler } from "./scheduler"
|
||||
|
||||
interface AgentServiceConfig {
|
||||
storage: ConversationStorage
|
||||
userSessionManager: UserSessionManager
|
||||
notificationCentral: NotificationCentral
|
||||
signal: AbortSignal
|
||||
}
|
||||
|
||||
export class AgentService {
|
||||
private readonly storage: ConversationStorage
|
||||
private readonly scheduler: AgentWorkScheduler
|
||||
private readonly reconciler: AgentResponseReconciler
|
||||
private readonly worker: Worker<AgentResponseJobPayload>
|
||||
|
||||
private readonly jobRegistry = new JobRegistry<AgentResponseJobPayload>()
|
||||
|
||||
constructor({ storage, userSessionManager, notificationCentral, signal }: AgentServiceConfig) {
|
||||
this.storage = storage
|
||||
this.scheduler = new AgentWorkScheduler({
|
||||
storage,
|
||||
jobRegistry: this.jobRegistry,
|
||||
waitTIme: 5 * 1000,
|
||||
maxWaitTime: 5 * 1000 * 60,
|
||||
})
|
||||
this.reconciler = new AgentResponseReconciler({
|
||||
signal,
|
||||
storage: this.storage,
|
||||
interval: 60 * 1000,
|
||||
scheduler: this.scheduler,
|
||||
})
|
||||
this.worker = new Worker<AgentResponseJobPayload>({
|
||||
signal,
|
||||
concurrency: 10,
|
||||
registry: this.jobRegistry,
|
||||
runner: new AgentResponseJobExecutor({
|
||||
conversationStorage: storage,
|
||||
notificationCentral,
|
||||
userSessionManager,
|
||||
}),
|
||||
})
|
||||
}
|
||||
|
||||
start() {
|
||||
this.worker.start()
|
||||
this.reconciler.start()
|
||||
}
|
||||
|
||||
async scheduleAgentResponse(conversationId: string, message: string) {
|
||||
await this.scheduler.receiveMessage(conversationId, message)
|
||||
}
|
||||
|
||||
async handleUserEvent(conversationId: string, event: UserEvent) {
|
||||
await this.scheduler.receiveUserEvent(conversationId, event)
|
||||
}
|
||||
}
|
||||
@@ -1,8 +1,8 @@
|
||||
import { ConversationEntryKind } from "@freya/core"
|
||||
import { describe, expect, test } from "bun:test"
|
||||
|
||||
import type { ConversationStorageEntry } from "./conversation-recording-query-agent.ts"
|
||||
|
||||
import { ConversationEntryKind } from "../conversations/types.ts"
|
||||
import { createSessionManager } from "./session-manager.ts"
|
||||
|
||||
describe("createSessionManager", () => {
|
||||
|
||||
@@ -1,18 +1,21 @@
|
||||
import { SessionManager } from "@earendil-works/pi-coding-agent"
|
||||
import { tmpdir } from "node:os"
|
||||
|
||||
import type { ConversationStorageEntry } from "./conversation-recording-query-agent.ts"
|
||||
|
||||
import {
|
||||
AssistantMessagePayload,
|
||||
ContextSummaryPayload,
|
||||
ConversationEntryKind,
|
||||
UserMessagePayload,
|
||||
} from "../conversations/types.ts"
|
||||
} from "@freya/core"
|
||||
import { tmpdir } from "node:os"
|
||||
|
||||
import type { ConversationStorageEntry } from "./conversation-recording-query-agent.ts"
|
||||
|
||||
/** Message shape accepted by Pi's SessionManager.appendMessage API. */
|
||||
type PiMessage = Parameters<SessionManager["appendMessage"]>[0]
|
||||
|
||||
/** Assistant message variant required when replaying stored assistant entries. */
|
||||
type PiAssistantMessage = Extract<PiMessage, { role: "assistant" }>
|
||||
|
||||
/** Inputs required to rebuild a Pi session manager from stored conversation entries. */
|
||||
export interface CreateSessionManagerInput {
|
||||
cwd?: string
|
||||
entries: ConversationStorageEntry[]
|
||||
|
||||
@@ -9,7 +9,6 @@ import type {
|
||||
QueryAgentEventListener,
|
||||
QueryAgentStreamEvent,
|
||||
} from "./query-agent.ts"
|
||||
import type { AgentResponseStreamItem } from "./streaming.ts"
|
||||
|
||||
import { streamAgentResponse } from "./streaming.ts"
|
||||
|
||||
@@ -47,17 +46,13 @@ describe("streamAgentResponse", () => {
|
||||
{ type: "done" },
|
||||
])
|
||||
|
||||
const { events, result } = await collectStreamAgentResponse(
|
||||
const events = await collectStreamAgentResponse(
|
||||
streamAgentResponse({
|
||||
agent,
|
||||
input: { message: "hello" },
|
||||
}),
|
||||
)
|
||||
|
||||
expect(result).toEqual({
|
||||
conversationId: "conversation-1",
|
||||
message: "First message\nSecond message\nThird message",
|
||||
})
|
||||
expect(events).toEqual([
|
||||
{ type: "conversation_started", conversationId: "conversation-1" },
|
||||
{ type: "message_created", text: "First message" },
|
||||
@@ -74,17 +69,13 @@ describe("streamAgentResponse", () => {
|
||||
{ type: "done" },
|
||||
])
|
||||
|
||||
const { events, result } = await collectStreamAgentResponse(
|
||||
const events = await collectStreamAgentResponse(
|
||||
streamAgentResponse({
|
||||
agent,
|
||||
input: { message: "hello" },
|
||||
}),
|
||||
)
|
||||
|
||||
expect(result).toEqual({
|
||||
conversationId: "conversation-1",
|
||||
message: " const value = 1 \n\n return value",
|
||||
})
|
||||
expect(events).toEqual([
|
||||
{ type: "conversation_started", conversationId: "conversation-1" },
|
||||
{ type: "message_created", text: " const value = 1 " },
|
||||
@@ -122,28 +113,12 @@ describe("streamAgentResponse", () => {
|
||||
})
|
||||
|
||||
async function collectStreamAgentResponse(
|
||||
stream: AsyncIterable<AgentResponseStreamItem>,
|
||||
stream: AsyncIterable<AgentEvent>,
|
||||
events: AgentEvent[] = [],
|
||||
): Promise<{
|
||||
events: AgentEvent[]
|
||||
result: { message: string; conversationId: string }
|
||||
}> {
|
||||
let result: { message: string; conversationId: string } | null = null
|
||||
|
||||
for await (const item of stream) {
|
||||
switch (item.type) {
|
||||
case "event":
|
||||
events.push(item.event)
|
||||
break
|
||||
case "result":
|
||||
result = item.result
|
||||
break
|
||||
}
|
||||
): Promise<AgentEvent[]> {
|
||||
for await (const event of stream) {
|
||||
events.push(event)
|
||||
}
|
||||
|
||||
if (!result) {
|
||||
throw new Error("Expected stream result")
|
||||
}
|
||||
|
||||
return { events, result }
|
||||
return events
|
||||
}
|
||||
|
||||
@@ -1,10 +1,8 @@
|
||||
import type { AgentEvent, SendMessageResult } from "@freya/agent-protocol"
|
||||
import type { AgentEvent } from "@freya/agent-protocol"
|
||||
|
||||
import type { QueryAgent, QueryAgentAsk } from "./query-agent.ts"
|
||||
|
||||
export type AgentResponseStreamItem =
|
||||
| { type: "event"; event: AgentEvent }
|
||||
| { type: "result"; result: SendMessageResult }
|
||||
export type AgentResponseStreamItem = { type: "event"; event: AgentEvent }
|
||||
|
||||
export async function* streamAgentResponse({
|
||||
agent,
|
||||
@@ -12,18 +10,18 @@ export async function* streamAgentResponse({
|
||||
}: {
|
||||
agent: QueryAgent
|
||||
input: QueryAgentAsk
|
||||
}): AsyncGenerator<AgentResponseStreamItem, void, void> {
|
||||
}): AsyncGenerator<AgentEvent, void, void> {
|
||||
let message = ""
|
||||
let conversationId: string | null = null
|
||||
const splitter = new AgentMessageSplitter()
|
||||
|
||||
function messageEvent(text: string): AgentResponseStreamItem | null {
|
||||
function messageEvent(text: string): AgentEvent | null {
|
||||
if (text.trim() === "") return null
|
||||
|
||||
return { type: "event", event: { type: "message_created", text } }
|
||||
return { type: "message_created", text }
|
||||
}
|
||||
|
||||
function flushPendingMessage(): AgentResponseStreamItem | null {
|
||||
function flushPendingMessage(): AgentEvent | null {
|
||||
const text = splitter.flush()
|
||||
if (text === null) return null
|
||||
|
||||
@@ -31,10 +29,14 @@ export async function* streamAgentResponse({
|
||||
}
|
||||
|
||||
for await (const event of agent.ask(input)) {
|
||||
if (input.signal?.aborted) {
|
||||
break
|
||||
}
|
||||
|
||||
switch (event.type) {
|
||||
case "conversation":
|
||||
conversationId = event.conversationId
|
||||
yield { type: "event", event: { type: "conversation_started", conversationId } }
|
||||
yield { type: "conversation_started", conversationId }
|
||||
break
|
||||
|
||||
case "text_delta":
|
||||
@@ -50,7 +52,7 @@ export async function* streamAgentResponse({
|
||||
const item = flushPendingMessage()
|
||||
if (item) yield item
|
||||
}
|
||||
yield { type: "event", event: { type: "tool_started", toolName: event.toolName } }
|
||||
yield { type: "tool_started", toolName: event.toolName }
|
||||
break
|
||||
|
||||
case "tool_end":
|
||||
@@ -59,12 +61,9 @@ export async function* streamAgentResponse({
|
||||
if (item) yield item
|
||||
}
|
||||
yield {
|
||||
type: "event",
|
||||
event: {
|
||||
type: "tool_finished",
|
||||
toolName: event.toolName,
|
||||
ok: event.ok,
|
||||
},
|
||||
}
|
||||
break
|
||||
|
||||
@@ -73,7 +72,7 @@ export async function* streamAgentResponse({
|
||||
const item = flushPendingMessage()
|
||||
if (item) yield item
|
||||
}
|
||||
yield { type: "event", event: { type: "message_failed", error: event.message } }
|
||||
yield { type: "message_failed", error: event.message }
|
||||
throw new Error(event.message)
|
||||
|
||||
case "done":
|
||||
@@ -81,26 +80,15 @@ export async function* streamAgentResponse({
|
||||
const item = flushPendingMessage()
|
||||
if (item) yield item
|
||||
}
|
||||
const result = createResult(message, conversationId)
|
||||
yield { type: "event", event: { type: "message_finished" } }
|
||||
yield { type: "result", result }
|
||||
yield { type: "message_finished" }
|
||||
return
|
||||
}
|
||||
}
|
||||
|
||||
const item = flushPendingMessage()
|
||||
if (item) yield item
|
||||
const result = createResult(message, conversationId)
|
||||
yield { type: "event", event: { type: "message_finished" } }
|
||||
yield { type: "result", result }
|
||||
}
|
||||
|
||||
function createResult(message: string, conversationId: string | null): SendMessageResult {
|
||||
if (!conversationId) {
|
||||
throw new Error("Agent response stream ended without a conversation id")
|
||||
}
|
||||
|
||||
return { message, conversationId }
|
||||
yield { type: "message_finished" }
|
||||
}
|
||||
|
||||
class AgentMessageSplitter {
|
||||
|
||||
@@ -1,8 +1,10 @@
|
||||
import { describe, expect, test } from "bun:test"
|
||||
import { Hono } from "hono"
|
||||
|
||||
import type { UserSessionManager } from "../session/index.ts"
|
||||
import type { ConversationStorage } from "../conversations/storage.ts"
|
||||
import type { NotificationCentral } from "../notification/notification-central.ts"
|
||||
|
||||
import type { AgentService } from "./service.ts"
|
||||
import { registerAgentWebSocketHandlers } from "./ws.ts"
|
||||
|
||||
describe("agent websocket handler", () => {
|
||||
@@ -11,7 +13,9 @@ describe("agent websocket handler", () => {
|
||||
const app = new Hono()
|
||||
|
||||
registerAgentWebSocketHandlers(app, {
|
||||
sessionManager: {} as UserSessionManager,
|
||||
agentService: {} as AgentService,
|
||||
storage: {} as ConversationStorage,
|
||||
notificationCentral: {} as NotificationCentral,
|
||||
corsMiddleware: async (c, next) => {
|
||||
const origin = c.req.header("origin")
|
||||
if (origin && origin !== "https://app.freya.test") {
|
||||
@@ -44,7 +48,9 @@ describe("agent websocket handler", () => {
|
||||
const app = new Hono()
|
||||
|
||||
registerAgentWebSocketHandlers(app, {
|
||||
sessionManager: {} as UserSessionManager,
|
||||
agentService: {} as AgentService,
|
||||
storage: {} as ConversationStorage,
|
||||
notificationCentral: {} as NotificationCentral,
|
||||
corsMiddleware: async (_c, next) => {
|
||||
await next()
|
||||
},
|
||||
|
||||
@@ -1,53 +1,58 @@
|
||||
import type { AgentClientApi, AgentServerApi, SendMessageResult } from "@freya/agent-protocol"
|
||||
import type { AgentClientApi, AgentServerApi, UserEvent } from "@freya/agent-protocol"
|
||||
import type { JrpcChannel, JrpcMessage, JsonRpcMessage } from "@nym.sh/jrpc"
|
||||
import type { Hono, MiddlewareHandler } from "hono"
|
||||
import type { WSContext } from "hono/ws"
|
||||
|
||||
import { JsonRpcClient, JsonRpcServer } from "@nym.sh/jrpc"
|
||||
import { type } from "arktype"
|
||||
import { JsonRpcClient, JsonRpcServer, deserializeJrpcMessage } from "@nym.sh/jrpc"
|
||||
import { upgradeWebSocket, websocket } from "hono/bun"
|
||||
|
||||
import type { AuthSessionMiddleware } from "../auth/session-middleware.ts"
|
||||
import type { UserSessionManager } from "../session/index.ts"
|
||||
|
||||
import { streamAgentResponse } from "./streaming.ts"
|
||||
import type { ConversationStorage } from "../conversations/storage.ts"
|
||||
import type {
|
||||
NotificationCentral,
|
||||
NotificationPayload,
|
||||
} from "../notification/notification-central.ts"
|
||||
import type { AgentService } from "./service.ts"
|
||||
|
||||
interface AgentWebSocketHandlerDeps {
|
||||
sessionManager: UserSessionManager
|
||||
agentService: AgentService
|
||||
storage: ConversationStorage
|
||||
notificationCentral: NotificationCentral
|
||||
authSessionMiddleware: AuthSessionMiddleware
|
||||
corsMiddleware: MiddlewareHandler
|
||||
}
|
||||
|
||||
interface ValidSendMessageInput {
|
||||
message: string
|
||||
}
|
||||
|
||||
export const agentWebSocket = websocket
|
||||
|
||||
const SendMessageInputBody = type({
|
||||
"+": "reject",
|
||||
message: "string",
|
||||
})
|
||||
|
||||
export function registerAgentWebSocketHandlers(
|
||||
app: Hono,
|
||||
{ sessionManager, authSessionMiddleware, corsMiddleware }: AgentWebSocketHandlerDeps,
|
||||
{
|
||||
agentService,
|
||||
storage,
|
||||
notificationCentral,
|
||||
authSessionMiddleware,
|
||||
corsMiddleware,
|
||||
}: AgentWebSocketHandlerDeps,
|
||||
): void {
|
||||
app.get(
|
||||
"/api/agent/ws",
|
||||
corsMiddleware,
|
||||
authSessionMiddleware,
|
||||
upgradeWebSocket((c) => {
|
||||
upgradeWebSocket(async (c) => {
|
||||
const user = c.get("user")
|
||||
if (!user) {
|
||||
throw new Error("Authenticated WebSocket user missing")
|
||||
}
|
||||
|
||||
const conversation = await storage.getOrCreateConversation(user.id)
|
||||
|
||||
const channel = new HonoWebSocketJrpcChannel()
|
||||
const connection = new AgentRpcConnection({
|
||||
channel,
|
||||
sessionManager,
|
||||
notificationCentral,
|
||||
agentService,
|
||||
userId: user.id,
|
||||
conversationId: conversation.id,
|
||||
})
|
||||
|
||||
return {
|
||||
@@ -64,6 +69,7 @@ export function registerAgentWebSocketHandlers(
|
||||
},
|
||||
|
||||
onClose() {
|
||||
connection.close()
|
||||
channel.close()
|
||||
},
|
||||
}
|
||||
@@ -74,54 +80,52 @@ export function registerAgentWebSocketHandlers(
|
||||
class AgentRpcConnection implements AgentServerApi {
|
||||
private readonly client: JsonRpcClient<AgentClientApi>
|
||||
private readonly server: JsonRpcServer<AgentServerApi>
|
||||
private activeMessage: Promise<SendMessageResult> | null = null
|
||||
private readonly sessionManager: UserSessionManager
|
||||
private readonly agentService: AgentService
|
||||
private readonly notificationCentral: NotificationCentral
|
||||
private readonly userId: string
|
||||
private readonly conversationId: string
|
||||
|
||||
private cleanup: (() => void) | null = null
|
||||
|
||||
constructor({
|
||||
agentService,
|
||||
notificationCentral,
|
||||
channel,
|
||||
sessionManager,
|
||||
userId,
|
||||
conversationId,
|
||||
}: {
|
||||
agentService: AgentService
|
||||
notificationCentral: NotificationCentral
|
||||
channel: JrpcChannel
|
||||
sessionManager: UserSessionManager
|
||||
userId: string
|
||||
conversationId: string
|
||||
}) {
|
||||
this.sessionManager = sessionManager
|
||||
this.userId = userId
|
||||
this.client = new JsonRpcClient<AgentClientApi>(channel)
|
||||
this.agentService = agentService
|
||||
this.notificationCentral = notificationCentral
|
||||
this.userId = userId
|
||||
this.conversationId = conversationId
|
||||
this.server = new JsonRpcServer<AgentServerApi>(
|
||||
{
|
||||
sendMessage: this.sendMessage.bind(this),
|
||||
notify: this.notify.bind(this),
|
||||
ping: this.ping.bind(this),
|
||||
},
|
||||
channel,
|
||||
)
|
||||
}
|
||||
|
||||
start(): Promise<void> {
|
||||
return this.server.start()
|
||||
notify(event: UserEvent): void {
|
||||
this.agentService.handleUserEvent(this.conversationId, event)
|
||||
}
|
||||
|
||||
async sendMessage(message: string): Promise<SendMessageResult> {
|
||||
const parsed = SendMessageInputBody({ message })
|
||||
if (parsed instanceof type.errors) {
|
||||
throw new Error(parsed.summary)
|
||||
}
|
||||
|
||||
if (this.activeMessage) {
|
||||
throw new Error("A message is already running")
|
||||
}
|
||||
|
||||
const run = this.runMessage(parsed)
|
||||
this.activeMessage = run
|
||||
|
||||
async sendMessage(message: string): Promise<boolean> {
|
||||
try {
|
||||
return await run
|
||||
} finally {
|
||||
if (this.activeMessage === run) {
|
||||
this.activeMessage = null
|
||||
}
|
||||
await this.agentService.scheduleAgentResponse(this.conversationId, message)
|
||||
return true
|
||||
} catch (error) {
|
||||
console.log("[agent rpc connection] error when scheduling agent response", error)
|
||||
return false
|
||||
}
|
||||
}
|
||||
|
||||
@@ -129,26 +133,22 @@ class AgentRpcConnection implements AgentServerApi {
|
||||
return "pong"
|
||||
}
|
||||
|
||||
private async runMessage(input: ValidSendMessageInput): Promise<SendMessageResult> {
|
||||
const session = await this.sessionManager.getOrCreate(this.userId)
|
||||
let result: SendMessageResult | null = null
|
||||
|
||||
for await (const item of streamAgentResponse({ agent: session.agent, input })) {
|
||||
switch (item.type) {
|
||||
case "event":
|
||||
await this.client.call("notify", item.event)
|
||||
break
|
||||
case "result":
|
||||
result = item.result
|
||||
break
|
||||
}
|
||||
async start() {
|
||||
this.cleanup = this.notificationCentral.registerListenerForUser(
|
||||
this.userId,
|
||||
this.onNotificationReceived.bind(this),
|
||||
)
|
||||
await this.server.start()
|
||||
}
|
||||
|
||||
if (!result) {
|
||||
throw new Error("Agent response stream ended without a result")
|
||||
close() {
|
||||
this.cleanup?.()
|
||||
}
|
||||
|
||||
return result
|
||||
private async onNotificationReceived(notification: NotificationPayload) {
|
||||
if (notification.kind === "agent") {
|
||||
await this.client.call("notify", notification.payload)
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
@@ -171,7 +171,11 @@ class HonoWebSocketJrpcChannel implements JrpcChannel {
|
||||
}
|
||||
|
||||
receive(message: unknown): void {
|
||||
const parsed = parseJrpcMessage(message)
|
||||
if (typeof message !== "string") {
|
||||
return
|
||||
}
|
||||
|
||||
const parsed = deserializeJrpcMessage(message)
|
||||
if (!parsed) {
|
||||
this.ws?.close(1003, "Invalid JSON-RPC message")
|
||||
return
|
||||
@@ -236,52 +240,6 @@ class HonoWebSocketJrpcChannel implements JrpcChannel {
|
||||
}
|
||||
}
|
||||
|
||||
function parseJrpcMessage(message: unknown): JrpcMessage | null {
|
||||
const text = webSocketMessageText(message)
|
||||
if (text === null) return null
|
||||
|
||||
try {
|
||||
const value: unknown = JSON.parse(text)
|
||||
return isJrpcMessage(value) ? value : null
|
||||
} catch {
|
||||
return null
|
||||
}
|
||||
}
|
||||
|
||||
function webSocketMessageText(message: unknown): string | null {
|
||||
if (typeof message === "string") return message
|
||||
if (message instanceof ArrayBuffer) return Buffer.from(message).toString("utf8")
|
||||
if (ArrayBuffer.isView(message)) {
|
||||
return Buffer.from(message.buffer, message.byteOffset, message.byteLength).toString("utf8")
|
||||
}
|
||||
|
||||
return null
|
||||
}
|
||||
|
||||
function isJrpcMessage(value: unknown): value is JrpcMessage {
|
||||
if (typeof value !== "object" || value === null) return false
|
||||
if (!("jsonrpc" in value) || value.jsonrpc !== "2.0") return false
|
||||
|
||||
if ("method" in value) {
|
||||
return "id" in value && typeof value.id === "number" && typeof value.method === "string"
|
||||
}
|
||||
|
||||
if ("result" in value) {
|
||||
return "id" in value && typeof value.id === "number"
|
||||
}
|
||||
|
||||
if ("error" in value) {
|
||||
return (
|
||||
"id" in value &&
|
||||
typeof value.id === "number" &&
|
||||
typeof value.error === "object" &&
|
||||
value.error !== null
|
||||
)
|
||||
}
|
||||
|
||||
return false
|
||||
}
|
||||
|
||||
function errorMessage(error: unknown): string {
|
||||
return error instanceof Error ? error.message : String(error)
|
||||
}
|
||||
|
||||
686
apps/freya-backend/src/conversations/db-storage.ts
Normal file
686
apps/freya-backend/src/conversations/db-storage.ts
Normal file
@@ -0,0 +1,686 @@
|
||||
import {
|
||||
AssistantMessagePayload,
|
||||
AttachmentPayload,
|
||||
ConversationEntryKind,
|
||||
ConversationEntryMetadata,
|
||||
ConversationEntryVisibility,
|
||||
ContextSummaryPayload,
|
||||
GenericObjectPayload,
|
||||
UserMessagePayload,
|
||||
type ConversationEntryPayload,
|
||||
} from "@freya/core"
|
||||
import { type } from "arktype"
|
||||
import { and, asc, desc, eq, gte, inArray } from "drizzle-orm"
|
||||
import { alias } from "drizzle-orm/pg-core"
|
||||
|
||||
import type { Database } from "../db/index.ts"
|
||||
import type {
|
||||
AppendAttachmentEntryInput,
|
||||
AppendAttachmentEntryResult,
|
||||
AppendConversationEntryInput,
|
||||
ConversationEntryRow,
|
||||
ConversationResponseStateRow,
|
||||
ConversationRow,
|
||||
ConversationStorage,
|
||||
CreateFileInput,
|
||||
FileRow,
|
||||
ListConversationEntriesParams,
|
||||
UpdateConversationResponseStateInput,
|
||||
UpsertConversationResponseStateInput,
|
||||
} from "./storage.ts"
|
||||
|
||||
import {
|
||||
conversationEntries,
|
||||
ConversationResponseStateStatus,
|
||||
conversationResponseState as conversationResponseStateTable,
|
||||
conversations as conversationsTable,
|
||||
files,
|
||||
user,
|
||||
} from "../db/schema.ts"
|
||||
import { ConversationNotFoundError } from "./errors.ts"
|
||||
|
||||
const conversationEntryKind = type.enumerated(...Object.values(ConversationEntryKind))
|
||||
const conversationEntryVisibility = type.enumerated(...Object.values(ConversationEntryVisibility))
|
||||
const pendingSinceEntry = alias(conversationEntries, "pending_since_entry")
|
||||
|
||||
export class DrizzleConversationStorage implements ConversationStorage {
|
||||
private readonly db: Database
|
||||
private readonly inTransaction: boolean
|
||||
|
||||
constructor(db: Database, inTransaction = false) {
|
||||
this.db = db
|
||||
this.inTransaction = inTransaction
|
||||
}
|
||||
|
||||
async transaction<T>(tx: (storage: ConversationStorage) => T | Promise<T>): Promise<T> {
|
||||
if (this.inTransaction) return tx(this)
|
||||
|
||||
return this.db.transaction(async (transactionDb) =>
|
||||
tx(new DrizzleConversationStorage(transactionDb, true)),
|
||||
)
|
||||
}
|
||||
|
||||
async createConversation(userId: string): Promise<ConversationRow> {
|
||||
return insertConversation(this.db, userId)
|
||||
}
|
||||
|
||||
async listUserConversations(userId: string): Promise<ConversationRow[]> {
|
||||
return this.db
|
||||
.select()
|
||||
.from(conversationsTable)
|
||||
.where(eq(conversationsTable.userId, userId))
|
||||
.orderBy(desc(conversationsTable.updatedAt), desc(conversationsTable.createdAt))
|
||||
}
|
||||
|
||||
async findConversation(conversationId: string): Promise<ConversationRow | null> {
|
||||
return findConversation(this.db, conversationId)
|
||||
}
|
||||
|
||||
async getOrCreateConversation(userId: string): Promise<ConversationRow> {
|
||||
return this.write(async (db) => {
|
||||
await requireUserForUpdate(db, userId)
|
||||
const existing = await latestConversation(db, userId)
|
||||
if (existing) return existing
|
||||
|
||||
return insertConversation(db, userId)
|
||||
})
|
||||
}
|
||||
|
||||
async createFile(userId: string, input: CreateFileInput): Promise<FileRow> {
|
||||
return insertFile(this.db, userId, input)
|
||||
}
|
||||
|
||||
async appendEntry(
|
||||
conversationId: string,
|
||||
input: AppendConversationEntryInput,
|
||||
): Promise<ConversationEntryRow> {
|
||||
return this.write((db) => appendEntryToConversation(db, null, conversationId, input))
|
||||
}
|
||||
|
||||
async appendAttachmentEntry(
|
||||
conversationId: string,
|
||||
input: AppendAttachmentEntryInput,
|
||||
): Promise<AppendAttachmentEntryResult> {
|
||||
return this.write((db) => appendAttachmentEntryToConversation(db, null, conversationId, input))
|
||||
}
|
||||
|
||||
async nextSequence(conversationId: string): Promise<number> {
|
||||
return nextSequence(this.db, conversationId)
|
||||
}
|
||||
|
||||
async listUserConversationEntries(
|
||||
userId: string,
|
||||
conversationId: string,
|
||||
params: ListConversationEntriesParams = {},
|
||||
): Promise<ConversationEntryRow[]> {
|
||||
if (!(await findUserConversation(this.db, userId, conversationId))) {
|
||||
throw new ConversationNotFoundError(conversationId, userId)
|
||||
}
|
||||
|
||||
if (params.visibility) {
|
||||
return this.db
|
||||
.select()
|
||||
.from(conversationEntries)
|
||||
.where(
|
||||
and(
|
||||
eq(conversationEntries.conversationId, conversationId),
|
||||
eq(conversationEntries.visibility, params.visibility),
|
||||
),
|
||||
)
|
||||
.orderBy(asc(conversationEntries.sequence))
|
||||
}
|
||||
|
||||
return this.db
|
||||
.select()
|
||||
.from(conversationEntries)
|
||||
.where(eq(conversationEntries.conversationId, conversationId))
|
||||
.orderBy(asc(conversationEntries.sequence))
|
||||
}
|
||||
|
||||
async listPendingUserConversationEntries(
|
||||
userId: string,
|
||||
conversationId: string,
|
||||
): Promise<ConversationEntryRow[]> {
|
||||
const entries = await this.db
|
||||
.select({ entry: conversationEntries })
|
||||
.from(conversationResponseStateTable)
|
||||
.innerJoin(
|
||||
conversationsTable,
|
||||
and(
|
||||
eq(conversationsTable.id, conversationResponseStateTable.conversationId),
|
||||
eq(conversationsTable.userId, userId),
|
||||
),
|
||||
)
|
||||
.innerJoin(
|
||||
pendingSinceEntry,
|
||||
and(
|
||||
eq(pendingSinceEntry.id, conversationResponseStateTable.pendingSinceEntryId),
|
||||
eq(pendingSinceEntry.conversationId, conversationResponseStateTable.conversationId),
|
||||
),
|
||||
)
|
||||
.innerJoin(
|
||||
conversationEntries,
|
||||
and(
|
||||
eq(conversationEntries.conversationId, conversationResponseStateTable.conversationId),
|
||||
eq(conversationEntries.kind, ConversationEntryKind.UserMessage),
|
||||
gte(conversationEntries.sequence, pendingSinceEntry.sequence),
|
||||
),
|
||||
)
|
||||
.where(
|
||||
and(
|
||||
eq(conversationResponseStateTable.conversationId, conversationId),
|
||||
eq(conversationEntries.conversationId, conversationId),
|
||||
),
|
||||
)
|
||||
.orderBy(asc(conversationEntries.sequence))
|
||||
|
||||
if (entries.length > 0) return entries.map(({ entry }) => entry)
|
||||
if (await findUserConversation(this.db, userId, conversationId)) return []
|
||||
|
||||
throw new ConversationNotFoundError(conversationId, userId)
|
||||
}
|
||||
|
||||
async findConversationResponseState(
|
||||
conversationId: string,
|
||||
): Promise<ConversationResponseStateRow | null> {
|
||||
const rows = await this.db
|
||||
.select()
|
||||
.from(conversationResponseStateTable)
|
||||
.where(eq(conversationResponseStateTable.conversationId, conversationId))
|
||||
.limit(1)
|
||||
|
||||
return rows[0] ?? null
|
||||
}
|
||||
|
||||
async listPendingResponseStates(): Promise<ConversationResponseStateRow[]> {
|
||||
const rows = await this.db
|
||||
.select()
|
||||
.from(conversationResponseStateTable)
|
||||
.where(eq(conversationResponseStateTable.status, ConversationResponseStateStatus.Pending))
|
||||
|
||||
return rows
|
||||
}
|
||||
|
||||
async listRunningResponseStates(): Promise<ConversationResponseStateRow[]> {
|
||||
const rows = await this.db
|
||||
.select()
|
||||
.from(conversationResponseStateTable)
|
||||
.where(eq(conversationResponseStateTable.status, ConversationResponseStateStatus.Running))
|
||||
|
||||
return rows
|
||||
}
|
||||
|
||||
async upsertConversationResponseState(
|
||||
conversationId: string,
|
||||
input: UpsertConversationResponseStateInput,
|
||||
): Promise<ConversationResponseStateRow> {
|
||||
const now = new Date()
|
||||
|
||||
return this.write(async (db) => {
|
||||
if (!(await findConversationByIdForUpdate(db, conversationId))) {
|
||||
throw new ConversationNotFoundError(conversationId, "")
|
||||
}
|
||||
|
||||
const rows = await db
|
||||
.insert(conversationResponseStateTable)
|
||||
.values({
|
||||
conversationId,
|
||||
status: input.status ?? ConversationResponseStateStatus.Pending,
|
||||
pendingSinceEntryId: input.pendingSinceEntryId,
|
||||
maxWaitUntil: input.maxWaitUntil,
|
||||
runningSince: input.runningSince ?? null,
|
||||
updatedAt: now,
|
||||
})
|
||||
.onConflictDoUpdate({
|
||||
target: conversationResponseStateTable.conversationId,
|
||||
set: {
|
||||
status: input.status ?? ConversationResponseStateStatus.Pending,
|
||||
maxWaitUntil: input.maxWaitUntil,
|
||||
runningSince: input.runningSince ?? null,
|
||||
updatedAt: now,
|
||||
},
|
||||
})
|
||||
.returning()
|
||||
|
||||
return requireRow(rows)
|
||||
})
|
||||
}
|
||||
|
||||
async updateConversationResponseState(
|
||||
conversationId: string,
|
||||
input: UpdateConversationResponseStateInput,
|
||||
): Promise<ConversationResponseStateRow | null> {
|
||||
return this.write(async (db) => {
|
||||
if (!(await findConversationByIdForUpdate(db, conversationId))) {
|
||||
throw new ConversationNotFoundError(conversationId, "")
|
||||
}
|
||||
|
||||
const rows = await db
|
||||
.update(conversationResponseStateTable)
|
||||
.set({
|
||||
status: input.status,
|
||||
pendingSinceEntryId: input.pendingSinceEntryId,
|
||||
maxWaitUntil: input.maxWaitUntil,
|
||||
runningSince: input.runningSince,
|
||||
updatedAt: new Date(),
|
||||
})
|
||||
.where(eq(conversationResponseStateTable.conversationId, conversationId))
|
||||
.returning()
|
||||
|
||||
return rows[0] ?? null
|
||||
})
|
||||
}
|
||||
|
||||
async markResponseStateStatus(
|
||||
conversationIds: string[],
|
||||
status: ConversationResponseStateStatus,
|
||||
): Promise<ConversationResponseStateRow[]> {
|
||||
return this.write(async (db) => {
|
||||
const now = new Date()
|
||||
|
||||
let runningSince: Date | null
|
||||
switch (status) {
|
||||
case "pending":
|
||||
case "failed":
|
||||
runningSince = null
|
||||
break
|
||||
case "running":
|
||||
runningSince = now
|
||||
break
|
||||
}
|
||||
|
||||
const rows = await db
|
||||
.update(conversationResponseStateTable)
|
||||
.set({
|
||||
status,
|
||||
runningSince,
|
||||
updatedAt: now,
|
||||
})
|
||||
.where(inArray(conversationResponseStateTable.conversationId, conversationIds))
|
||||
.returning()
|
||||
|
||||
return rows
|
||||
})
|
||||
}
|
||||
|
||||
async claimPendingConversationResponseState(
|
||||
conversationId: string,
|
||||
): Promise<ConversationResponseStateRow | null> {
|
||||
return this.write(async (db) => {
|
||||
const now = new Date()
|
||||
const rows = await db
|
||||
.update(conversationResponseStateTable)
|
||||
.set({
|
||||
status: "running",
|
||||
runningSince: now,
|
||||
updatedAt: now,
|
||||
})
|
||||
.where(
|
||||
and(
|
||||
eq(conversationResponseStateTable.conversationId, conversationId),
|
||||
eq(conversationResponseStateTable.status, "pending"),
|
||||
),
|
||||
)
|
||||
.returning()
|
||||
|
||||
return rows[0] ?? null
|
||||
})
|
||||
}
|
||||
|
||||
async clearConversationResponseState(conversationId: string): Promise<void> {
|
||||
await this.write(async (db) => {
|
||||
if (!(await findConversationByIdForUpdate(db, conversationId))) {
|
||||
throw new ConversationNotFoundError(conversationId, "")
|
||||
}
|
||||
|
||||
await db
|
||||
.delete(conversationResponseStateTable)
|
||||
.where(eq(conversationResponseStateTable.conversationId, conversationId))
|
||||
})
|
||||
}
|
||||
|
||||
private async write<T>(fn: (db: Database) => Promise<T>): Promise<T> {
|
||||
if (this.inTransaction) return fn(this.db)
|
||||
|
||||
return this.db.transaction(fn)
|
||||
}
|
||||
}
|
||||
|
||||
export function createConversationStorage(db: Database): ConversationStorage {
|
||||
return new DrizzleConversationStorage(db)
|
||||
}
|
||||
|
||||
export function conversations(db: Database, userId: string) {
|
||||
const storage = createConversationStorage(db)
|
||||
|
||||
return {
|
||||
createConversation(): Promise<ConversationRow> {
|
||||
return storage.createConversation(userId)
|
||||
},
|
||||
|
||||
listConversations(): Promise<ConversationRow[]> {
|
||||
return storage.listUserConversations(userId)
|
||||
},
|
||||
|
||||
getConversation(conversationId: string): Promise<ConversationRow | null> {
|
||||
return findUserConversation(db, userId, conversationId)
|
||||
},
|
||||
|
||||
getOrCreateConversation(): Promise<ConversationRow> {
|
||||
return storage.getOrCreateConversation(userId)
|
||||
},
|
||||
|
||||
createFile(input: CreateFileInput): Promise<FileRow> {
|
||||
return storage.createFile(userId, input)
|
||||
},
|
||||
|
||||
appendEntry(
|
||||
conversationId: string,
|
||||
input: AppendConversationEntryInput,
|
||||
): Promise<ConversationEntryRow> {
|
||||
return db.transaction((tx) => appendEntryToConversation(tx, userId, conversationId, input))
|
||||
},
|
||||
|
||||
appendAttachmentEntry(
|
||||
conversationId: string,
|
||||
input: AppendAttachmentEntryInput,
|
||||
): Promise<AppendAttachmentEntryResult> {
|
||||
return db.transaction((tx) =>
|
||||
appendAttachmentEntryToConversation(tx, userId, conversationId, input),
|
||||
)
|
||||
},
|
||||
|
||||
listEntries(
|
||||
conversationId: string,
|
||||
params: ListConversationEntriesParams = {},
|
||||
): Promise<ConversationEntryRow[]> {
|
||||
return storage.listUserConversationEntries(userId, conversationId, params)
|
||||
},
|
||||
}
|
||||
}
|
||||
|
||||
export function conversationResponse(db: Database, _userId: string, conversationId: string) {
|
||||
const storage = createConversationStorage(db)
|
||||
|
||||
return {
|
||||
get(): Promise<ConversationResponseStateRow | null> {
|
||||
return storage.findConversationResponseState(conversationId)
|
||||
},
|
||||
|
||||
upsert(input: UpsertConversationResponseStateInput): Promise<ConversationResponseStateRow> {
|
||||
return storage.upsertConversationResponseState(conversationId, input)
|
||||
},
|
||||
|
||||
update(
|
||||
input: UpdateConversationResponseStateInput,
|
||||
): Promise<ConversationResponseStateRow | null> {
|
||||
return storage.updateConversationResponseState(conversationId, input)
|
||||
},
|
||||
|
||||
clear(): Promise<void> {
|
||||
return storage.clearConversationResponseState(conversationId)
|
||||
},
|
||||
}
|
||||
}
|
||||
|
||||
function payloadForKind(
|
||||
kind: ConversationEntryKind,
|
||||
payload: AppendConversationEntryInput["payload"],
|
||||
): ConversationEntryPayload {
|
||||
switch (kind) {
|
||||
case ConversationEntryKind.UserMessage:
|
||||
return UserMessagePayload.assert(payload)
|
||||
case ConversationEntryKind.AssistantMessage:
|
||||
return AssistantMessagePayload.assert(payload)
|
||||
case ConversationEntryKind.Attachment:
|
||||
return AttachmentPayload.assert(payload)
|
||||
case ConversationEntryKind.ContextSummary:
|
||||
return ContextSummaryPayload.assert(payload)
|
||||
case ConversationEntryKind.ToolCall:
|
||||
case ConversationEntryKind.ToolResult:
|
||||
case ConversationEntryKind.SystemNote:
|
||||
return GenericObjectPayload.assert(payload)
|
||||
}
|
||||
}
|
||||
|
||||
async function appendEntryToConversation(
|
||||
db: Database,
|
||||
userId: string | null,
|
||||
conversationId: string,
|
||||
input: AppendConversationEntryInput,
|
||||
): Promise<ConversationEntryRow> {
|
||||
const kind = conversationEntryKind.assert(input.kind)
|
||||
const visibility = conversationEntryVisibility.assert(
|
||||
input.visibility ?? defaultVisibilityForKind(kind),
|
||||
)
|
||||
const payload = payloadForKind(kind, input.payload)
|
||||
const metadata = ConversationEntryMetadata.assert(input.metadata ?? {})
|
||||
let fileId: string | null = null
|
||||
|
||||
if (input.kind === ConversationEntryKind.Attachment) {
|
||||
fileId = input.fileId
|
||||
}
|
||||
|
||||
const conversation = userId
|
||||
? await findConversationForUpdate(db, userId, conversationId)
|
||||
: await findConversationByIdForUpdate(db, conversationId)
|
||||
if (!conversation) {
|
||||
throw new ConversationNotFoundError(conversationId, userId ?? "")
|
||||
}
|
||||
if (fileId) await requireFile(db, conversation.userId, fileId)
|
||||
|
||||
const sequence = await nextSequence(db, conversationId)
|
||||
const rows = await db
|
||||
.insert(conversationEntries)
|
||||
.values({
|
||||
conversationId,
|
||||
sequence,
|
||||
kind,
|
||||
visibility,
|
||||
fileId,
|
||||
payload,
|
||||
metadata,
|
||||
})
|
||||
.returning()
|
||||
|
||||
await touchConversation(db, conversation.userId, conversationId)
|
||||
return requireRow(rows)
|
||||
}
|
||||
|
||||
async function appendAttachmentEntryToConversation(
|
||||
db: Database,
|
||||
userId: string | null,
|
||||
conversationId: string,
|
||||
input: AppendAttachmentEntryInput,
|
||||
): Promise<AppendAttachmentEntryResult> {
|
||||
const payload = AttachmentPayload.assert(input.payload)
|
||||
const visibility = conversationEntryVisibility.assert(
|
||||
input.visibility ?? defaultVisibilityForKind(ConversationEntryKind.Attachment),
|
||||
)
|
||||
const metadata = ConversationEntryMetadata.assert(input.metadata ?? {})
|
||||
const conversation = userId
|
||||
? await findConversationForUpdate(db, userId, conversationId)
|
||||
: await findConversationByIdForUpdate(db, conversationId)
|
||||
|
||||
if (!conversation) {
|
||||
throw new ConversationNotFoundError(conversationId, userId ?? "")
|
||||
}
|
||||
|
||||
const file = await insertFile(db, conversation.userId, input.file)
|
||||
const sequence = await nextSequence(db, conversationId)
|
||||
const rows = await db
|
||||
.insert(conversationEntries)
|
||||
.values({
|
||||
conversationId,
|
||||
sequence,
|
||||
kind: ConversationEntryKind.Attachment,
|
||||
visibility,
|
||||
fileId: file.id,
|
||||
payload,
|
||||
metadata,
|
||||
})
|
||||
.returning()
|
||||
|
||||
await touchConversation(db, conversation.userId, conversationId)
|
||||
return {
|
||||
file,
|
||||
entry: requireRow(rows),
|
||||
}
|
||||
}
|
||||
|
||||
async function requireUserForUpdate(db: Database, userId: string): Promise<void> {
|
||||
const rows = await db
|
||||
.select({ id: user.id })
|
||||
.from(user)
|
||||
.where(eq(user.id, userId))
|
||||
.limit(1)
|
||||
.for("update")
|
||||
|
||||
requireRow(rows, `User not found: ${userId}`)
|
||||
}
|
||||
|
||||
export async function findConversation(
|
||||
db: Database,
|
||||
conversationId: string,
|
||||
): Promise<ConversationRow | null> {
|
||||
const rows = await db
|
||||
.select()
|
||||
.from(conversationsTable)
|
||||
.where(eq(conversationsTable.id, conversationId))
|
||||
.limit(1)
|
||||
|
||||
return rows[0] ?? null
|
||||
}
|
||||
|
||||
async function findUserConversation(
|
||||
db: Database,
|
||||
userId: string,
|
||||
conversationId: string,
|
||||
): Promise<ConversationRow | null> {
|
||||
const rows = await db
|
||||
.select()
|
||||
.from(conversationsTable)
|
||||
.where(and(eq(conversationsTable.id, conversationId), eq(conversationsTable.userId, userId)))
|
||||
.limit(1)
|
||||
|
||||
return rows[0] ?? null
|
||||
}
|
||||
|
||||
async function findConversationForUpdate(
|
||||
db: Database,
|
||||
userId: string,
|
||||
conversationId: string,
|
||||
): Promise<ConversationRow | null> {
|
||||
const rows = await db
|
||||
.select()
|
||||
.from(conversationsTable)
|
||||
.where(and(eq(conversationsTable.id, conversationId), eq(conversationsTable.userId, userId)))
|
||||
.limit(1)
|
||||
.for("update")
|
||||
|
||||
return rows[0] ?? null
|
||||
}
|
||||
|
||||
async function findConversationByIdForUpdate(
|
||||
db: Database,
|
||||
conversationId: string,
|
||||
): Promise<ConversationRow | null> {
|
||||
const rows = await db
|
||||
.select()
|
||||
.from(conversationsTable)
|
||||
.where(eq(conversationsTable.id, conversationId))
|
||||
.limit(1)
|
||||
.for("update")
|
||||
|
||||
return rows[0] ?? null
|
||||
}
|
||||
|
||||
async function latestConversation(db: Database, userId: string): Promise<ConversationRow | null> {
|
||||
const rows = await db
|
||||
.select()
|
||||
.from(conversationsTable)
|
||||
.where(eq(conversationsTable.userId, userId))
|
||||
.orderBy(desc(conversationsTable.updatedAt), desc(conversationsTable.createdAt))
|
||||
.limit(1)
|
||||
|
||||
return rows[0] ?? null
|
||||
}
|
||||
|
||||
async function insertConversation(db: Database, userId: string): Promise<ConversationRow> {
|
||||
const rows = await db
|
||||
.insert(conversationsTable)
|
||||
.values({
|
||||
userId,
|
||||
})
|
||||
.returning()
|
||||
|
||||
return requireRow(rows)
|
||||
}
|
||||
|
||||
async function requireFile(db: Database, userId: string, fileId: string): Promise<FileRow> {
|
||||
const rows = await db
|
||||
.select()
|
||||
.from(files)
|
||||
.where(and(eq(files.id, fileId), eq(files.userId, userId)))
|
||||
.limit(1)
|
||||
|
||||
return requireRow(rows, `File not found: ${fileId}`)
|
||||
}
|
||||
|
||||
async function insertFile(db: Database, userId: string, input: CreateFileInput): Promise<FileRow> {
|
||||
const rows = await db
|
||||
.insert(files)
|
||||
.values({
|
||||
userId,
|
||||
storageKey: input.storageKey,
|
||||
originalName: input.originalName ?? null,
|
||||
mimeType: input.mimeType,
|
||||
sizeBytes: input.sizeBytes,
|
||||
metadata: input.metadata ?? {},
|
||||
})
|
||||
.returning()
|
||||
|
||||
return requireRow(rows)
|
||||
}
|
||||
|
||||
async function touchConversation(
|
||||
db: Database,
|
||||
userId: string,
|
||||
conversationId: string,
|
||||
): Promise<void> {
|
||||
await db
|
||||
.update(conversationsTable)
|
||||
.set({ updatedAt: new Date() })
|
||||
.where(and(eq(conversationsTable.id, conversationId), eq(conversationsTable.userId, userId)))
|
||||
}
|
||||
|
||||
async function nextSequence(db: Database, conversationId: string): Promise<number> {
|
||||
const rows = await db
|
||||
.select({ sequence: conversationEntries.sequence })
|
||||
.from(conversationEntries)
|
||||
.where(eq(conversationEntries.conversationId, conversationId))
|
||||
.orderBy(desc(conversationEntries.sequence))
|
||||
.limit(1)
|
||||
|
||||
return (rows[0]?.sequence ?? 0) + 1
|
||||
}
|
||||
|
||||
function requireRow<T>(rows: T[], message = "Expected database row"): T {
|
||||
const row = rows[0]
|
||||
if (!row) throw new Error(message)
|
||||
return row
|
||||
}
|
||||
|
||||
function defaultVisibilityForKind(kind: ConversationEntryKind): ConversationEntryVisibility {
|
||||
switch (kind) {
|
||||
case ConversationEntryKind.UserMessage:
|
||||
case ConversationEntryKind.AssistantMessage:
|
||||
case ConversationEntryKind.Attachment:
|
||||
return ConversationEntryVisibility.UserVisible
|
||||
case ConversationEntryKind.ToolCall:
|
||||
case ConversationEntryKind.ToolResult:
|
||||
case ConversationEntryKind.ContextSummary:
|
||||
case ConversationEntryKind.SystemNote:
|
||||
return ConversationEntryVisibility.Internal
|
||||
}
|
||||
}
|
||||
11
apps/freya-backend/src/conversations/errors.ts
Normal file
11
apps/freya-backend/src/conversations/errors.ts
Normal file
@@ -0,0 +1,11 @@
|
||||
export class ConversationNotFoundError extends Error {
|
||||
readonly conversationId: string
|
||||
readonly userId: string
|
||||
|
||||
constructor(conversationId: string, userId: string) {
|
||||
super(`Conversation "${conversationId}" not found for user "${userId}"`)
|
||||
this.name = "ConversationNotFoundError"
|
||||
this.conversationId = conversationId
|
||||
this.userId = userId
|
||||
}
|
||||
}
|
||||
@@ -1,21 +1,55 @@
|
||||
import { ConversationEntryKind, ConversationEntryVisibility } from "@freya/core"
|
||||
import { beforeEach, describe, expect, mock, test } from "bun:test"
|
||||
import { Hono } from "hono"
|
||||
|
||||
import type { Database } from "../db/index.ts"
|
||||
import type { ConversationRow } from "./storage.ts"
|
||||
import type {
|
||||
ConversationEntryRow,
|
||||
ConversationRow,
|
||||
ListConversationEntriesParams,
|
||||
} from "./storage.ts"
|
||||
|
||||
import { mockAuthSessionMiddleware } from "../auth/session-middleware.ts"
|
||||
import { ConversationNotFoundError } from "./errors.ts"
|
||||
import { registerConversationsHttpHandlers } from "./http.ts"
|
||||
|
||||
const MockUserId = "k7Gx2mPqRvNwYs9TdLfA4bHcJeUo1iZn"
|
||||
const ConversationId = "11111111-1111-4111-8111-111111111111"
|
||||
const MissingConversationId = "22222222-2222-4222-8222-222222222222"
|
||||
|
||||
const conversationRowsByUser = new Map<string, ConversationRow[]>()
|
||||
const conversationEntryRowsByUserAndConversation = new Map<string, ConversationEntryRow[]>()
|
||||
const listEntriesCalls: Array<{
|
||||
userId: string
|
||||
conversationId: string
|
||||
params: ListConversationEntriesParams
|
||||
}> = []
|
||||
|
||||
mock.module("./storage.ts", () => ({
|
||||
mock.module("./db-storage.ts", () => ({
|
||||
conversations: (_db: Database, userId: string) => ({
|
||||
async listConversations(): Promise<ConversationRow[]> {
|
||||
return conversationRowsByUser.get(userId) ?? []
|
||||
},
|
||||
|
||||
async listEntries(
|
||||
conversationId: string,
|
||||
params: ListConversationEntriesParams = {},
|
||||
): Promise<ConversationEntryRow[]> {
|
||||
listEntriesCalls.push({ userId, conversationId, params })
|
||||
|
||||
const rows = conversationEntryRowsByUserAndConversation.get(
|
||||
conversationEntriesKey(userId, conversationId),
|
||||
)
|
||||
if (!rows) {
|
||||
throw new ConversationNotFoundError(conversationId, userId)
|
||||
}
|
||||
|
||||
if (params.visibility) {
|
||||
return rows.filter((row) => row.visibility === params.visibility)
|
||||
}
|
||||
|
||||
return rows
|
||||
},
|
||||
}),
|
||||
}))
|
||||
|
||||
@@ -44,9 +78,39 @@ function createConversationRow(
|
||||
}
|
||||
}
|
||||
|
||||
function createConversationEntryRow(
|
||||
id: string,
|
||||
conversationId: string,
|
||||
sequence: number,
|
||||
kind: ConversationEntryRow["kind"],
|
||||
visibility: ConversationEntryRow["visibility"],
|
||||
payload: ConversationEntryRow["payload"],
|
||||
createdAt: string,
|
||||
metadata: ConversationEntryRow["metadata"] = {},
|
||||
fileId: string | null = null,
|
||||
): ConversationEntryRow {
|
||||
return {
|
||||
id,
|
||||
conversationId,
|
||||
sequence,
|
||||
kind,
|
||||
visibility,
|
||||
fileId,
|
||||
payload,
|
||||
metadata,
|
||||
createdAt: new Date(createdAt),
|
||||
}
|
||||
}
|
||||
|
||||
function conversationEntriesKey(userId: string, conversationId: string): string {
|
||||
return `${userId}:${conversationId}`
|
||||
}
|
||||
|
||||
describe("GET /api/conversations", () => {
|
||||
beforeEach(() => {
|
||||
conversationRowsByUser.clear()
|
||||
conversationEntryRowsByUserAndConversation.clear()
|
||||
listEntriesCalls.length = 0
|
||||
})
|
||||
|
||||
test("returns 401 without auth", async () => {
|
||||
@@ -108,3 +172,162 @@ describe("GET /api/conversations", () => {
|
||||
})
|
||||
})
|
||||
})
|
||||
|
||||
describe("GET /api/conversations/:id/entries", () => {
|
||||
beforeEach(() => {
|
||||
conversationRowsByUser.clear()
|
||||
conversationEntryRowsByUserAndConversation.clear()
|
||||
listEntriesCalls.length = 0
|
||||
})
|
||||
|
||||
test("returns 401 without auth", async () => {
|
||||
const app = buildTestApp()
|
||||
|
||||
const res = await app.request("/api/conversations/conversation-1/entries")
|
||||
|
||||
expect(res.status).toBe(401)
|
||||
})
|
||||
|
||||
test("returns user-visible entries for the authenticated user", async () => {
|
||||
conversationEntryRowsByUserAndConversation.set(
|
||||
conversationEntriesKey(MockUserId, ConversationId),
|
||||
[
|
||||
createConversationEntryRow(
|
||||
"entry-user",
|
||||
ConversationId,
|
||||
1,
|
||||
ConversationEntryKind.UserMessage,
|
||||
ConversationEntryVisibility.UserVisible,
|
||||
{
|
||||
role: "user",
|
||||
parts: [{ type: "text", text: "What is on today?" }],
|
||||
},
|
||||
"2026-06-17T09:30:00.000Z",
|
||||
),
|
||||
createConversationEntryRow(
|
||||
"entry-tool",
|
||||
ConversationId,
|
||||
2,
|
||||
ConversationEntryKind.ToolCall,
|
||||
ConversationEntryVisibility.Internal,
|
||||
{
|
||||
toolName: "freya_list_context",
|
||||
input: {},
|
||||
},
|
||||
"2026-06-17T09:30:01.000Z",
|
||||
),
|
||||
createConversationEntryRow(
|
||||
"entry-assistant",
|
||||
ConversationId,
|
||||
3,
|
||||
ConversationEntryKind.AssistantMessage,
|
||||
ConversationEntryVisibility.UserVisible,
|
||||
{
|
||||
role: "assistant",
|
||||
parts: [{ type: "text", text: "You have two calendar events." }],
|
||||
},
|
||||
"2026-06-17T09:30:02.000Z",
|
||||
{ runId: "run-1" },
|
||||
),
|
||||
],
|
||||
)
|
||||
const app = buildTestApp("user-1")
|
||||
|
||||
const res = await app.request(`/api/conversations/${ConversationId}/entries`)
|
||||
|
||||
expect(res.status).toBe(200)
|
||||
expect(listEntriesCalls).toEqual([
|
||||
{
|
||||
userId: MockUserId,
|
||||
conversationId: ConversationId,
|
||||
params: { visibility: ConversationEntryVisibility.UserVisible },
|
||||
},
|
||||
])
|
||||
|
||||
const body = (await res.json()) as { entries: unknown[] }
|
||||
expect(body).toEqual({
|
||||
entries: [
|
||||
{
|
||||
id: "entry-user",
|
||||
conversationId: ConversationId,
|
||||
sequence: 1,
|
||||
kind: ConversationEntryKind.UserMessage,
|
||||
visibility: ConversationEntryVisibility.UserVisible,
|
||||
fileId: null,
|
||||
payload: {
|
||||
role: "user",
|
||||
parts: [{ type: "text", text: "What is on today?" }],
|
||||
},
|
||||
metadata: {},
|
||||
createdAt: "2026-06-17T09:30:00.000Z",
|
||||
},
|
||||
{
|
||||
id: "entry-assistant",
|
||||
conversationId: ConversationId,
|
||||
sequence: 3,
|
||||
kind: ConversationEntryKind.AssistantMessage,
|
||||
visibility: ConversationEntryVisibility.UserVisible,
|
||||
fileId: null,
|
||||
payload: {
|
||||
role: "assistant",
|
||||
parts: [{ type: "text", text: "You have two calendar events." }],
|
||||
},
|
||||
metadata: { runId: "run-1" },
|
||||
createdAt: "2026-06-17T09:30:02.000Z",
|
||||
},
|
||||
],
|
||||
})
|
||||
})
|
||||
|
||||
test("returns an empty list when the conversation has no user-visible entries", async () => {
|
||||
conversationEntryRowsByUserAndConversation.set(
|
||||
conversationEntriesKey(MockUserId, ConversationId),
|
||||
[
|
||||
createConversationEntryRow(
|
||||
"entry-tool",
|
||||
ConversationId,
|
||||
1,
|
||||
ConversationEntryKind.ToolResult,
|
||||
ConversationEntryVisibility.Internal,
|
||||
{ toolCallId: "call-1", output: { ok: true } },
|
||||
"2026-06-17T09:30:00.000Z",
|
||||
),
|
||||
],
|
||||
)
|
||||
const app = buildTestApp("user-1")
|
||||
|
||||
const res = await app.request(`/api/conversations/${ConversationId}/entries`)
|
||||
|
||||
expect(res.status).toBe(200)
|
||||
const body = (await res.json()) as { entries: unknown[] }
|
||||
expect(body).toEqual({ entries: [] })
|
||||
})
|
||||
|
||||
test("returns 404 for malformed conversation ids without querying storage", async () => {
|
||||
const app = buildTestApp("user-1")
|
||||
|
||||
const res = await app.request("/api/conversations/missing-conversation/entries")
|
||||
|
||||
expect(res.status).toBe(404)
|
||||
expect(listEntriesCalls).toEqual([])
|
||||
const body = (await res.json()) as { error: string }
|
||||
expect(body).toEqual({ error: "Conversation not found" })
|
||||
})
|
||||
|
||||
test("returns 404 when the conversation does not exist for the user", async () => {
|
||||
const app = buildTestApp("user-1")
|
||||
|
||||
const res = await app.request(`/api/conversations/${MissingConversationId}/entries`)
|
||||
|
||||
expect(res.status).toBe(404)
|
||||
expect(listEntriesCalls).toEqual([
|
||||
{
|
||||
userId: MockUserId,
|
||||
conversationId: MissingConversationId,
|
||||
params: { visibility: ConversationEntryVisibility.UserVisible },
|
||||
},
|
||||
])
|
||||
const body = (await res.json()) as { error: string }
|
||||
expect(body).toEqual({ error: "Conversation not found" })
|
||||
})
|
||||
})
|
||||
|
||||
@@ -1,23 +1,38 @@
|
||||
import type { Context, Hono } from "hono"
|
||||
|
||||
import { ConversationEntryVisibility } from "@freya/core"
|
||||
import { type } from "arktype"
|
||||
import { createMiddleware } from "hono/factory"
|
||||
|
||||
import type { AuthSessionMiddleware } from "../auth/session-middleware.ts"
|
||||
import type { Database } from "../db/index.ts"
|
||||
import type { ConversationRow } from "./storage.ts"
|
||||
|
||||
import { conversations } from "./storage.ts"
|
||||
import { conversations } from "./db-storage.ts"
|
||||
import { ConversationNotFoundError } from "./errors.ts"
|
||||
|
||||
/** Hono environment populated by the conversations route middleware. */
|
||||
type Env = {
|
||||
Variables: {
|
||||
db: Database
|
||||
}
|
||||
}
|
||||
|
||||
/** Serialized conversation summary returned by the list endpoint. */
|
||||
interface ConversationSummaryResponse {
|
||||
id: string
|
||||
createdAt: string
|
||||
updatedAt: string
|
||||
}
|
||||
|
||||
/** Dependencies required to register conversation HTTP handlers. */
|
||||
interface ConversationsHttpHandlersDeps {
|
||||
db: Database
|
||||
authSessionMiddleware: AuthSessionMiddleware
|
||||
}
|
||||
|
||||
const ConversationIdParam = type("string.uuid")
|
||||
|
||||
export function registerConversationsHttpHandlers(
|
||||
app: Hono,
|
||||
{ db, authSessionMiddleware }: ConversationsHttpHandlersDeps,
|
||||
@@ -28,6 +43,7 @@ export function registerConversationsHttpHandlers(
|
||||
})
|
||||
|
||||
app.get("/api/conversations", inject, authSessionMiddleware, handleListConversations)
|
||||
app.get("/api/conversations/:id/entries", inject, authSessionMiddleware, handleListEntries)
|
||||
}
|
||||
|
||||
async function handleListConversations(c: Context<Env>) {
|
||||
@@ -35,10 +51,54 @@ async function handleListConversations(c: Context<Env>) {
|
||||
const db = c.get("db")
|
||||
|
||||
return c.json({
|
||||
conversations: (await conversations(db, user.id).listConversations()).map((row) => ({
|
||||
conversations: (await conversations(db, user.id).listConversations()).map(
|
||||
serializeConversation,
|
||||
),
|
||||
})
|
||||
}
|
||||
|
||||
async function handleListEntries(c: Context<Env>) {
|
||||
const user = c.get("user")!
|
||||
const db = c.get("db")
|
||||
const conversationId = c.req.param("id")
|
||||
if (!conversationId) {
|
||||
return c.json({ error: "Conversation not found" }, 404)
|
||||
}
|
||||
const parsedConversationId = ConversationIdParam(conversationId)
|
||||
if (parsedConversationId instanceof type.errors) {
|
||||
return c.json({ error: "Conversation not found" }, 404)
|
||||
}
|
||||
|
||||
try {
|
||||
const entries = await conversations(db, user.id).listEntries(parsedConversationId, {
|
||||
visibility: ConversationEntryVisibility.UserVisible,
|
||||
})
|
||||
|
||||
return c.json({
|
||||
entries: entries.map((row) => ({
|
||||
id: row.id,
|
||||
conversationId: row.conversationId,
|
||||
sequence: row.sequence,
|
||||
kind: row.kind,
|
||||
visibility: row.visibility,
|
||||
fileId: row.fileId,
|
||||
payload: row.payload,
|
||||
metadata: row.metadata,
|
||||
createdAt: row.createdAt.toISOString(),
|
||||
})),
|
||||
})
|
||||
} catch (err) {
|
||||
if (err instanceof ConversationNotFoundError) {
|
||||
return c.json({ error: "Conversation not found" }, 404)
|
||||
}
|
||||
throw err
|
||||
}
|
||||
}
|
||||
|
||||
function serializeConversation(row: ConversationRow): ConversationSummaryResponse {
|
||||
return {
|
||||
id: row.id,
|
||||
createdAt: row.createdAt.toISOString(),
|
||||
updatedAt: row.updatedAt.toISOString(),
|
||||
})),
|
||||
})
|
||||
}
|
||||
}
|
||||
|
||||
@@ -1,41 +1,85 @@
|
||||
import { and, asc, desc, eq } from "drizzle-orm"
|
||||
|
||||
import type { Database } from "../db/index.ts"
|
||||
import type {
|
||||
import {
|
||||
AssistantMessagePayload,
|
||||
AttachmentPayload,
|
||||
ContextSummaryPayload,
|
||||
ConversationEntryKind as ConversationEntryKindType,
|
||||
ConversationEntryKind,
|
||||
ConversationEntryMetadata,
|
||||
ConversationEntryPayload,
|
||||
ConversationEntryVisibility as ConversationEntryVisibilityType,
|
||||
ConversationEntryVisibility,
|
||||
ContextSummaryPayload,
|
||||
GenericObjectPayload,
|
||||
UserMessagePayload,
|
||||
} from "./types.ts"
|
||||
} from "@freya/core"
|
||||
|
||||
import {
|
||||
conversationEntries,
|
||||
conversationResponseState as conversationResponseStateTable,
|
||||
conversations as conversationsTable,
|
||||
files,
|
||||
user,
|
||||
type ConversationResponseStateStatus,
|
||||
} from "../db/schema.ts"
|
||||
import {
|
||||
ConversationEntryMetadata as ConversationEntryMetadataSchema,
|
||||
AssistantMessagePayload as AssistantMessagePayloadSchema,
|
||||
AttachmentPayload as AttachmentPayloadSchema,
|
||||
ConversationEntryKind,
|
||||
ConversationEntryKindInput,
|
||||
ConversationEntryVisibility,
|
||||
ConversationEntryVisibilityInput,
|
||||
ContextSummaryPayload as ContextSummaryPayloadSchema,
|
||||
GenericObjectPayload as GenericObjectPayloadSchema,
|
||||
UserMessagePayload as UserMessagePayloadSchema,
|
||||
} from "./types.ts"
|
||||
|
||||
export interface ConversationStorage {
|
||||
transaction<T>(tx: (storage: ConversationStorage) => T | Promise<T>): Promise<T>
|
||||
createConversation(userId: string): Promise<ConversationRow>
|
||||
listUserConversations(userId: string): Promise<ConversationRow[]>
|
||||
findConversation(conversationId: string): Promise<ConversationRow | null>
|
||||
getOrCreateConversation(userId: string): Promise<ConversationRow>
|
||||
createFile(userId: string, input: CreateFileInput): Promise<FileRow>
|
||||
appendEntry(
|
||||
conversationId: string,
|
||||
input: AppendConversationEntryInput,
|
||||
): Promise<ConversationEntryRow>
|
||||
appendAttachmentEntry(
|
||||
conversationId: string,
|
||||
input: AppendAttachmentEntryInput,
|
||||
): Promise<AppendAttachmentEntryResult>
|
||||
nextSequence(conversationId: string): Promise<number>
|
||||
listUserConversationEntries(
|
||||
userId: string,
|
||||
conversationId: string,
|
||||
params?: ListConversationEntriesParams,
|
||||
): Promise<ConversationEntryRow[]>
|
||||
listPendingUserConversationEntries(
|
||||
userId: string,
|
||||
conversationId: string,
|
||||
): Promise<ConversationEntryRow[]>
|
||||
findConversationResponseState(
|
||||
conversationId: string,
|
||||
): Promise<ConversationResponseStateRow | null>
|
||||
// TODO: add pagination support
|
||||
listPendingResponseStates(): Promise<ConversationResponseStateRow[]>
|
||||
// TODO: add pagination support
|
||||
listRunningResponseStates(): Promise<ConversationResponseStateRow[]>
|
||||
upsertConversationResponseState(
|
||||
conversationId: string,
|
||||
input: UpsertConversationResponseStateInput,
|
||||
): Promise<ConversationResponseStateRow>
|
||||
updateConversationResponseState(
|
||||
conversationId: string,
|
||||
input: UpdateConversationResponseStateInput,
|
||||
): Promise<ConversationResponseStateRow | null>
|
||||
markResponseStateStatus(
|
||||
conversationIds: string[],
|
||||
status: ConversationResponseStateStatus,
|
||||
): Promise<ConversationResponseStateRow[]>
|
||||
claimPendingConversationResponseState(
|
||||
conversationId: string,
|
||||
): Promise<ConversationResponseStateRow | null>
|
||||
clearConversationResponseState(conversationId: string): Promise<void>
|
||||
}
|
||||
|
||||
/** Database row shape for a conversation owned by a user. */
|
||||
export type ConversationRow = typeof conversationsTable.$inferSelect
|
||||
|
||||
/** Database row shape for an entry in a conversation timeline. */
|
||||
export type ConversationEntryRow = typeof conversationEntries.$inferSelect
|
||||
|
||||
/** Database row shape for pending assistant response state in a conversation. */
|
||||
export type ConversationResponseStateRow = typeof conversationResponseStateTable.$inferSelect
|
||||
|
||||
/** Database row shape for an uploaded file referenced by conversations. */
|
||||
export type FileRow = typeof files.$inferSelect
|
||||
|
||||
/** Input required to create a stored file record. */
|
||||
export interface CreateFileInput {
|
||||
storageKey: string
|
||||
originalName?: string
|
||||
@@ -44,23 +88,27 @@ export interface CreateFileInput {
|
||||
metadata?: Record<string, unknown>
|
||||
}
|
||||
|
||||
/** Input for creating a file and appending its attachment entry together. */
|
||||
export interface AppendAttachmentEntryInput {
|
||||
file: CreateFileInput
|
||||
payload: AttachmentPayload
|
||||
visibility?: ConversationEntryVisibilityType
|
||||
visibility?: ConversationEntryVisibility
|
||||
metadata?: ConversationEntryMetadata
|
||||
}
|
||||
|
||||
/** Result returned after a file-backed attachment entry is appended. */
|
||||
export interface AppendAttachmentEntryResult {
|
||||
file: FileRow
|
||||
entry: ConversationEntryRow
|
||||
}
|
||||
|
||||
/** Common fields accepted when appending any conversation entry. */
|
||||
interface AppendConversationEntryBase {
|
||||
visibility?: ConversationEntryVisibilityType
|
||||
visibility?: ConversationEntryVisibility
|
||||
metadata?: ConversationEntryMetadata
|
||||
}
|
||||
|
||||
/** Discriminated input for appending any supported entry kind to a conversation. */
|
||||
export type AppendConversationEntryInput =
|
||||
| (AppendConversationEntryBase & {
|
||||
kind: typeof ConversationEntryKind.UserMessage
|
||||
@@ -91,291 +139,31 @@ export type AppendConversationEntryInput =
|
||||
fileId?: never
|
||||
})
|
||||
|
||||
/** Filters accepted when listing conversation entries. */
|
||||
export interface ListConversationEntriesParams {
|
||||
visibility?: ConversationEntryVisibilityType
|
||||
visibility?: ConversationEntryVisibility
|
||||
}
|
||||
|
||||
export function conversations(db: Database, userId: string) {
|
||||
return {
|
||||
async createConversation(): Promise<ConversationRow> {
|
||||
return insertConversation(db, userId)
|
||||
},
|
||||
|
||||
async listConversations(): Promise<ConversationRow[]> {
|
||||
return db
|
||||
.select()
|
||||
.from(conversationsTable)
|
||||
.where(eq(conversationsTable.userId, userId))
|
||||
.orderBy(desc(conversationsTable.updatedAt), desc(conversationsTable.createdAt))
|
||||
},
|
||||
|
||||
async getOrCreateConversation(): Promise<ConversationRow> {
|
||||
return db.transaction(async (tx) => {
|
||||
await requireUserForUpdate(tx, userId)
|
||||
const existing = await latestConversation(tx, userId)
|
||||
if (existing) return existing
|
||||
|
||||
return insertConversation(tx, userId)
|
||||
})
|
||||
},
|
||||
|
||||
async createFile(input: CreateFileInput): Promise<FileRow> {
|
||||
return insertFile(db, userId, input)
|
||||
},
|
||||
|
||||
async appendEntry(
|
||||
conversationId: string,
|
||||
input: AppendConversationEntryInput,
|
||||
): Promise<ConversationEntryRow> {
|
||||
const kind = ConversationEntryKindInput.assert(input.kind)
|
||||
const visibility = ConversationEntryVisibilityInput.assert(
|
||||
input.visibility ?? defaultVisibilityForKind(kind),
|
||||
)
|
||||
const payload = payloadForKind(kind, input.payload)
|
||||
const metadata = ConversationEntryMetadataSchema.assert(input.metadata ?? {})
|
||||
let fileId: string | null = null
|
||||
|
||||
if (input.kind === ConversationEntryKind.Attachment) {
|
||||
fileId = input.fileId
|
||||
await requireFile(db, userId, fileId)
|
||||
}
|
||||
|
||||
const rows = await db.transaction(async (tx) => {
|
||||
await requireConversationForUpdate(tx, userId, conversationId)
|
||||
const sequence = await nextSequence(tx, conversationId)
|
||||
|
||||
const rows = await tx
|
||||
.insert(conversationEntries)
|
||||
.values({
|
||||
conversationId,
|
||||
sequence,
|
||||
kind,
|
||||
visibility,
|
||||
fileId,
|
||||
payload,
|
||||
metadata,
|
||||
})
|
||||
.returning()
|
||||
|
||||
await touchConversation(tx, userId, conversationId)
|
||||
return rows
|
||||
})
|
||||
|
||||
return requireRow(rows)
|
||||
},
|
||||
|
||||
async appendAttachmentEntry(
|
||||
conversationId: string,
|
||||
input: AppendAttachmentEntryInput,
|
||||
): Promise<AppendAttachmentEntryResult> {
|
||||
const payload = AttachmentPayloadSchema.assert(input.payload)
|
||||
const visibility = ConversationEntryVisibilityInput.assert(
|
||||
input.visibility ?? defaultVisibilityForKind(ConversationEntryKind.Attachment),
|
||||
)
|
||||
const metadata = ConversationEntryMetadataSchema.assert(input.metadata ?? {})
|
||||
|
||||
return db.transaction(async (tx) => {
|
||||
await requireConversationForUpdate(tx, userId, conversationId)
|
||||
|
||||
const file = await insertFile(tx, userId, input.file)
|
||||
const sequence = await nextSequence(tx, conversationId)
|
||||
const rows = await tx
|
||||
.insert(conversationEntries)
|
||||
.values({
|
||||
conversationId,
|
||||
sequence,
|
||||
kind: ConversationEntryKind.Attachment,
|
||||
visibility,
|
||||
fileId: file.id,
|
||||
payload,
|
||||
metadata,
|
||||
})
|
||||
.returning()
|
||||
|
||||
await touchConversation(tx, userId, conversationId)
|
||||
return {
|
||||
file,
|
||||
entry: requireRow(rows),
|
||||
}
|
||||
})
|
||||
},
|
||||
|
||||
async listEntries(
|
||||
conversationId: string,
|
||||
params: ListConversationEntriesParams = {},
|
||||
): Promise<ConversationEntryRow[]> {
|
||||
await requireConversation(db, userId, conversationId)
|
||||
|
||||
if (params.visibility) {
|
||||
return db
|
||||
.select()
|
||||
.from(conversationEntries)
|
||||
.where(
|
||||
and(
|
||||
eq(conversationEntries.conversationId, conversationId),
|
||||
eq(conversationEntries.visibility, params.visibility),
|
||||
),
|
||||
)
|
||||
.orderBy(asc(conversationEntries.sequence))
|
||||
}
|
||||
|
||||
return db
|
||||
.select()
|
||||
.from(conversationEntries)
|
||||
.where(eq(conversationEntries.conversationId, conversationId))
|
||||
.orderBy(asc(conversationEntries.sequence))
|
||||
},
|
||||
}
|
||||
/** Input for creating or replacing pending assistant response state. */
|
||||
export interface UpsertConversationResponseStateInput {
|
||||
status?: ConversationResponseStateStatus
|
||||
pendingSinceEntryId: string
|
||||
maxWaitUntil: Date
|
||||
runningSince?: Date | null
|
||||
}
|
||||
|
||||
function payloadForKind(
|
||||
kind: ConversationEntryKindType,
|
||||
payload: AppendConversationEntryInput["payload"],
|
||||
): ConversationEntryPayload {
|
||||
switch (kind) {
|
||||
case ConversationEntryKind.UserMessage:
|
||||
return UserMessagePayloadSchema.assert(payload)
|
||||
case ConversationEntryKind.AssistantMessage:
|
||||
return AssistantMessagePayloadSchema.assert(payload)
|
||||
case ConversationEntryKind.Attachment:
|
||||
return AttachmentPayloadSchema.assert(payload)
|
||||
case ConversationEntryKind.ContextSummary:
|
||||
return ContextSummaryPayloadSchema.assert(payload)
|
||||
case ConversationEntryKind.ToolCall:
|
||||
case ConversationEntryKind.ToolResult:
|
||||
case ConversationEntryKind.SystemNote:
|
||||
return GenericObjectPayloadSchema.assert(payload)
|
||||
}
|
||||
/** Input for patching pending assistant response state. */
|
||||
export interface UpdateConversationResponseStateInput {
|
||||
status?: ConversationResponseStateStatus
|
||||
pendingSinceEntryId?: string
|
||||
maxWaitUntil?: Date
|
||||
runningSince?: Date | null
|
||||
}
|
||||
|
||||
async function requireUserForUpdate(db: Database, userId: string): Promise<void> {
|
||||
const rows = await db
|
||||
.select({ id: user.id })
|
||||
.from(user)
|
||||
.where(eq(user.id, userId))
|
||||
.limit(1)
|
||||
.for("update")
|
||||
|
||||
requireRow(rows, `User not found: ${userId}`)
|
||||
}
|
||||
|
||||
async function requireConversation(
|
||||
db: Database,
|
||||
userId: string,
|
||||
conversationId: string,
|
||||
): Promise<ConversationRow> {
|
||||
const rows = await db
|
||||
.select()
|
||||
.from(conversationsTable)
|
||||
.where(and(eq(conversationsTable.id, conversationId), eq(conversationsTable.userId, userId)))
|
||||
.limit(1)
|
||||
|
||||
return requireRow(rows, `Conversation not found: ${conversationId}`)
|
||||
}
|
||||
|
||||
async function requireConversationForUpdate(
|
||||
db: Database,
|
||||
userId: string,
|
||||
conversationId: string,
|
||||
): Promise<ConversationRow> {
|
||||
const rows = await db
|
||||
.select()
|
||||
.from(conversationsTable)
|
||||
.where(and(eq(conversationsTable.id, conversationId), eq(conversationsTable.userId, userId)))
|
||||
.limit(1)
|
||||
.for("update")
|
||||
|
||||
return requireRow(rows, `Conversation not found: ${conversationId}`)
|
||||
}
|
||||
|
||||
async function latestConversation(db: Database, userId: string): Promise<ConversationRow | null> {
|
||||
const rows = await db
|
||||
.select()
|
||||
.from(conversationsTable)
|
||||
.where(eq(conversationsTable.userId, userId))
|
||||
.orderBy(desc(conversationsTable.updatedAt), desc(conversationsTable.createdAt))
|
||||
.limit(1)
|
||||
|
||||
return rows[0] ?? null
|
||||
}
|
||||
|
||||
async function insertConversation(db: Database, userId: string): Promise<ConversationRow> {
|
||||
const rows = await db
|
||||
.insert(conversationsTable)
|
||||
.values({
|
||||
userId,
|
||||
})
|
||||
.returning()
|
||||
|
||||
return requireRow(rows)
|
||||
}
|
||||
|
||||
async function requireFile(db: Database, userId: string, fileId: string): Promise<FileRow> {
|
||||
const rows = await db
|
||||
.select()
|
||||
.from(files)
|
||||
.where(and(eq(files.id, fileId), eq(files.userId, userId)))
|
||||
.limit(1)
|
||||
|
||||
return requireRow(rows, `File not found: ${fileId}`)
|
||||
}
|
||||
|
||||
async function insertFile(db: Database, userId: string, input: CreateFileInput): Promise<FileRow> {
|
||||
const rows = await db
|
||||
.insert(files)
|
||||
.values({
|
||||
userId,
|
||||
storageKey: input.storageKey,
|
||||
originalName: input.originalName ?? null,
|
||||
mimeType: input.mimeType,
|
||||
sizeBytes: input.sizeBytes,
|
||||
metadata: input.metadata ?? {},
|
||||
})
|
||||
.returning()
|
||||
|
||||
return requireRow(rows)
|
||||
}
|
||||
|
||||
async function touchConversation(
|
||||
db: Database,
|
||||
userId: string,
|
||||
conversationId: string,
|
||||
): Promise<void> {
|
||||
await db
|
||||
.update(conversationsTable)
|
||||
.set({ updatedAt: new Date() })
|
||||
.where(and(eq(conversationsTable.id, conversationId), eq(conversationsTable.userId, userId)))
|
||||
}
|
||||
|
||||
async function nextSequence(db: Database, conversationId: string): Promise<number> {
|
||||
const rows = await db
|
||||
.select({ sequence: conversationEntries.sequence })
|
||||
.from(conversationEntries)
|
||||
.where(eq(conversationEntries.conversationId, conversationId))
|
||||
.orderBy(desc(conversationEntries.sequence))
|
||||
.limit(1)
|
||||
|
||||
return (rows[0]?.sequence ?? 0) + 1
|
||||
}
|
||||
|
||||
function requireRow<T>(rows: T[], message = "Expected database row"): T {
|
||||
const row = rows[0]
|
||||
if (!row) throw new Error(message)
|
||||
return row
|
||||
}
|
||||
|
||||
function defaultVisibilityForKind(
|
||||
kind: ConversationEntryKindType,
|
||||
): ConversationEntryVisibilityType {
|
||||
switch (kind) {
|
||||
case ConversationEntryKind.UserMessage:
|
||||
case ConversationEntryKind.AssistantMessage:
|
||||
case ConversationEntryKind.Attachment:
|
||||
return ConversationEntryVisibility.UserVisible
|
||||
case ConversationEntryKind.ToolCall:
|
||||
case ConversationEntryKind.ToolResult:
|
||||
case ConversationEntryKind.ContextSummary:
|
||||
case ConversationEntryKind.SystemNote:
|
||||
return ConversationEntryVisibility.Internal
|
||||
}
|
||||
}
|
||||
export {
|
||||
createConversationStorage,
|
||||
conversationResponse,
|
||||
conversations,
|
||||
DrizzleConversationStorage,
|
||||
findConversation,
|
||||
} from "./db-storage.ts"
|
||||
|
||||
@@ -1,3 +1,10 @@
|
||||
import {
|
||||
ConversationEntryVisibility,
|
||||
type ConversationEntryKind,
|
||||
type ConversationEntryMetadata,
|
||||
type ConversationEntryPayload,
|
||||
type ConversationEntryVisibility as ConversationEntryVisibilityType,
|
||||
} from "@freya/core"
|
||||
import { sql } from "drizzle-orm"
|
||||
import {
|
||||
boolean,
|
||||
@@ -13,14 +20,6 @@ import {
|
||||
uuid,
|
||||
} from "drizzle-orm/pg-core"
|
||||
|
||||
import {
|
||||
ConversationEntryVisibility,
|
||||
type ConversationEntryKind,
|
||||
type ConversationEntryMetadata,
|
||||
type ConversationEntryPayload,
|
||||
type ConversationEntryVisibility as ConversationEntryVisibilityType,
|
||||
} from "../conversations/types.ts"
|
||||
|
||||
// ---------------------------------------------------------------------------
|
||||
// Better Auth core tables
|
||||
// Re-exported from CLI-generated schema.
|
||||
@@ -49,6 +48,15 @@ const bytea = customType<{ data: Buffer }>({
|
||||
},
|
||||
})
|
||||
|
||||
export const ConversationResponseStateStatus = {
|
||||
Pending: "pending",
|
||||
Running: "running",
|
||||
Failed: "failed",
|
||||
} as const
|
||||
|
||||
export type ConversationResponseStateStatus =
|
||||
(typeof ConversationResponseStateStatus)[keyof typeof ConversationResponseStateStatus]
|
||||
|
||||
export const userSources = pgTable(
|
||||
"user_sources",
|
||||
{
|
||||
@@ -147,6 +155,38 @@ export const conversationEntries = pgTable(
|
||||
],
|
||||
)
|
||||
|
||||
export const conversationResponseState = pgTable(
|
||||
"conversation_response_state",
|
||||
{
|
||||
conversationId: uuid("conversation_id")
|
||||
.primaryKey()
|
||||
.references(() => conversations.id, { onDelete: "cascade" }),
|
||||
status: text("status")
|
||||
.$type<ConversationResponseStateStatus>()
|
||||
.notNull()
|
||||
.default(ConversationResponseStateStatus.Pending),
|
||||
pendingSinceEntryId: uuid("pending_since_entry_id")
|
||||
.notNull()
|
||||
.references(() => conversationEntries.id, { onDelete: "cascade" }),
|
||||
maxWaitUntil: timestamp("max_wait_until").notNull(),
|
||||
runningSince: timestamp("running_since"),
|
||||
createdAt: timestamp("created_at").notNull().defaultNow(),
|
||||
updatedAt: timestamp("updated_at")
|
||||
.notNull()
|
||||
.defaultNow()
|
||||
.$onUpdate(() => new Date()),
|
||||
},
|
||||
(t) => [
|
||||
index("conversation_response_state_status_max_wait_until_idx").on(t.status, t.maxWaitUntil),
|
||||
index("conversation_response_state_running_since_idx").on(t.runningSince),
|
||||
index("conversation_response_state_pending_since_entry_id_idx").on(t.pendingSinceEntryId),
|
||||
check(
|
||||
"conversation_response_state_status_check",
|
||||
sql`${t.status} in ('pending', 'running', 'failed')`,
|
||||
),
|
||||
],
|
||||
)
|
||||
|
||||
// ---------------------------------------------------------------------------
|
||||
// FREYA — reminders source storage
|
||||
// ---------------------------------------------------------------------------
|
||||
|
||||
@@ -14,7 +14,6 @@ interface FeedResponse {
|
||||
items: Array<{
|
||||
id: string
|
||||
type: string
|
||||
priority: number
|
||||
timestamp: string
|
||||
data: Record<string, unknown>
|
||||
}>
|
||||
@@ -85,7 +84,7 @@ mock.module("../sources/user-sources.ts", () => ({
|
||||
}),
|
||||
}))
|
||||
|
||||
mock.module("../conversations/storage.ts", () => ({
|
||||
mock.module("../conversations/db-storage.ts", () => ({
|
||||
conversations: (_db: Database, userId: string) => ({
|
||||
async getOrCreateConversation() {
|
||||
return { id: `conversation-${userId}` }
|
||||
@@ -118,7 +117,6 @@ describe("GET /api/feed", () => {
|
||||
id: "item-1",
|
||||
sourceId: "test",
|
||||
type: "test",
|
||||
priority: 0.8,
|
||||
timestamp: new Date("2025-01-01T00:00:00.000Z"),
|
||||
data: { value: 42 },
|
||||
},
|
||||
@@ -149,7 +147,6 @@ describe("GET /api/feed", () => {
|
||||
expect(body.items).toHaveLength(1)
|
||||
expect(body.items[0]!.id).toBe("item-1")
|
||||
expect(body.items[0]!.type).toBe("test")
|
||||
expect(body.items[0]!.priority).toBe(0.8)
|
||||
expect(body.items[0]!.timestamp).toBe("2025-01-01T00:00:00.000Z")
|
||||
expect(body.errors).toHaveLength(0)
|
||||
})
|
||||
@@ -160,7 +157,6 @@ describe("GET /api/feed", () => {
|
||||
id: "fresh-1",
|
||||
sourceId: "test",
|
||||
type: "test",
|
||||
priority: 0.5,
|
||||
timestamp: new Date("2025-06-01T12:00:00.000Z"),
|
||||
data: { fresh: true },
|
||||
},
|
||||
|
||||
@@ -135,8 +135,9 @@ describe("schema sync", () => {
|
||||
|
||||
// JSON Schema structure matches
|
||||
const jsonSchema = enhancementResultJsonSchema
|
||||
const payloadKeys = Object.keys(payload).sort() as Array<(typeof jsonSchema.required)[number]>
|
||||
expect(Object.keys(jsonSchema.properties).sort()).toEqual(Object.keys(payload).sort())
|
||||
expect([...jsonSchema.required].sort()).toEqual(Object.keys(payload).sort())
|
||||
expect([...jsonSchema.required].sort()).toEqual(payloadKeys)
|
||||
|
||||
// syntheticItems item schema has the right required fields
|
||||
const itemSchema = jsonSchema.properties.syntheticItems.items
|
||||
|
||||
116
apps/freya-backend/src/lib/job.ts
Normal file
116
apps/freya-backend/src/lib/job.ts
Normal file
@@ -0,0 +1,116 @@
|
||||
import { Queue } from "./queue"
|
||||
|
||||
const JobStatus = {
|
||||
Pending: "pending",
|
||||
Running: "running",
|
||||
} as const
|
||||
type JobStatus = (typeof JobStatus)[keyof typeof JobStatus]
|
||||
|
||||
export interface Job<Payload> {
|
||||
id: number
|
||||
payload: Payload
|
||||
signal: AbortSignal
|
||||
}
|
||||
|
||||
interface PendingJob<Payload> {
|
||||
status: typeof JobStatus.Pending
|
||||
controller: AbortController
|
||||
job: Job<Payload>
|
||||
}
|
||||
|
||||
interface RunningJob<Payload> {
|
||||
status: typeof JobStatus.Running
|
||||
controller: AbortController
|
||||
job: Job<Payload>
|
||||
}
|
||||
|
||||
type JobState<Payload> = PendingJob<Payload> | RunningJob<Payload>
|
||||
|
||||
type JobEventListener<Payload> = (job: Job<Payload>) => void
|
||||
|
||||
type JobEvent = "settled" | "cancelled"
|
||||
|
||||
export class JobRegistry<Payload> {
|
||||
private queue = new Queue<Job<Payload>>()
|
||||
|
||||
private states = new Map<number, JobState<Payload>>()
|
||||
|
||||
private listeners: Record<JobEvent, JobEventListener<Payload>[]> = {
|
||||
settled: [],
|
||||
cancelled: [],
|
||||
}
|
||||
|
||||
addJob({ payload }: { payload: Payload }): Job<Payload> {
|
||||
const controller = new AbortController()
|
||||
const job: Job<Payload> = {
|
||||
id: this.generateJobId(),
|
||||
payload,
|
||||
signal: controller.signal,
|
||||
}
|
||||
this.queue.enqueue(job)
|
||||
this.states.set(job.id, { status: JobStatus.Pending, controller, job })
|
||||
return job
|
||||
}
|
||||
|
||||
async nextJob(signal?: AbortSignal): Promise<Job<Payload> | null> {
|
||||
while (true) {
|
||||
const job = await this.queue.next(signal)
|
||||
if (!job) {
|
||||
return null
|
||||
}
|
||||
|
||||
const state = this.states.get(job.id)
|
||||
|
||||
if (!state || state.job !== job || state.status === JobStatus.Running) {
|
||||
continue
|
||||
}
|
||||
if (state.controller.signal.aborted) {
|
||||
this.states.delete(job.id)
|
||||
continue
|
||||
}
|
||||
|
||||
this.states.set(job.id, { status: JobStatus.Running, controller: state.controller, job })
|
||||
|
||||
return job
|
||||
}
|
||||
}
|
||||
|
||||
cancelJob(job: Job<unknown>): void {
|
||||
const state = this.states.get(job.id)
|
||||
if (state?.job === job) {
|
||||
state?.controller.abort()
|
||||
this.notifyListeners("cancelled", job.id)
|
||||
this.states.delete(job.id)
|
||||
}
|
||||
}
|
||||
|
||||
markJobAsCompleted(job: Job<unknown>): void {
|
||||
const state = this.states.get(job.id)
|
||||
if (state?.job === job) {
|
||||
this.notifyListeners("settled", job.id)
|
||||
this.states.delete(job.id)
|
||||
}
|
||||
}
|
||||
|
||||
addEventListener(event: JobEvent, listener: JobEventListener<Payload>): () => void {
|
||||
this.listeners[event].push(listener)
|
||||
return () => {
|
||||
this.listeners[event] = this.listeners[event].filter((l) => l !== listener)
|
||||
}
|
||||
}
|
||||
|
||||
private generateJobId(): number {
|
||||
let id: number
|
||||
do {
|
||||
id = Math.floor(Math.random() * 1000000)
|
||||
} while (this.states.has(id))
|
||||
return id
|
||||
}
|
||||
|
||||
private notifyListeners(event: JobEvent, id: number): void {
|
||||
const job = this.states.get(id)?.job
|
||||
if (job) {
|
||||
this.listeners[event].forEach((listener) => listener(job))
|
||||
}
|
||||
}
|
||||
}
|
||||
69
apps/freya-backend/src/lib/queue.ts
Normal file
69
apps/freya-backend/src/lib/queue.ts
Normal file
@@ -0,0 +1,69 @@
|
||||
interface Item<T> {
|
||||
value: T
|
||||
next: Item<T> | null
|
||||
}
|
||||
|
||||
export class Queue<T> {
|
||||
private front: Item<T> | null = null
|
||||
private back: Item<T> | null = null
|
||||
private waiters: Array<(value: T) => void> = []
|
||||
|
||||
enqueue(value: T): void {
|
||||
const waiter = this.waiters.shift()
|
||||
if (waiter) {
|
||||
waiter(value)
|
||||
return
|
||||
}
|
||||
|
||||
const newItem: Item<T> = { value, next: null }
|
||||
if (this.back) {
|
||||
this.back.next = newItem
|
||||
} else {
|
||||
this.front = newItem
|
||||
}
|
||||
this.back = newItem
|
||||
}
|
||||
|
||||
dequeue(): T | null {
|
||||
if (!this.front) return null
|
||||
const value = this.front.value
|
||||
this.front = this.front.next
|
||||
if (!this.front) this.back = null
|
||||
return value
|
||||
}
|
||||
|
||||
next(signal?: AbortSignal): Promise<T | null> {
|
||||
const value = this.dequeue()
|
||||
if (value !== null) return Promise.resolve(value)
|
||||
|
||||
return new Promise((resolve) => {
|
||||
if (signal) {
|
||||
if (signal.aborted) {
|
||||
resolve(null)
|
||||
} else {
|
||||
let _resolve: (v: T) => void
|
||||
|
||||
const onAbort = () => {
|
||||
this.waiters = this.waiters.filter((w) => w !== _resolve)
|
||||
resolve(null)
|
||||
}
|
||||
|
||||
signal.addEventListener(
|
||||
"abort",
|
||||
onAbort,
|
||||
{ once: true },
|
||||
)
|
||||
|
||||
_resolve = (v: T) => {
|
||||
signal.removeEventListener("abort", onAbort)
|
||||
resolve(v)
|
||||
}
|
||||
|
||||
this.waiters.push(_resolve)
|
||||
}
|
||||
} else {
|
||||
this.waiters.push(resolve)
|
||||
}
|
||||
})
|
||||
}
|
||||
}
|
||||
51
apps/freya-backend/src/lib/worker.ts
Normal file
51
apps/freya-backend/src/lib/worker.ts
Normal file
@@ -0,0 +1,51 @@
|
||||
import type { Job, JobRegistry } from "./job"
|
||||
import type { Queue } from "./queue"
|
||||
|
||||
export interface JobExecutor<JobPayload> {
|
||||
execute(job: Job<JobPayload>): Promise<void>
|
||||
}
|
||||
|
||||
export interface WorkerConfig<Job> {
|
||||
concurrency: number
|
||||
registry: JobRegistry<Job>
|
||||
runner: JobExecutor<Job>
|
||||
signal: AbortSignal
|
||||
}
|
||||
|
||||
export class Worker<Job> {
|
||||
private concurrency: number
|
||||
private registry: JobRegistry<Job>
|
||||
private runner: JobExecutor<Job>
|
||||
private signal: AbortSignal
|
||||
|
||||
constructor({ concurrency, registry, runner, signal }: WorkerConfig<Job>) {
|
||||
this.concurrency = concurrency
|
||||
this.registry = registry
|
||||
this.runner = runner
|
||||
this.signal = signal
|
||||
}
|
||||
|
||||
start() {
|
||||
if (this.signal.aborted) return
|
||||
for (let i = 0; i < this.concurrency; i++) {
|
||||
void this.pollJobFromRegistry()
|
||||
}
|
||||
}
|
||||
|
||||
private async pollJobFromRegistry() {
|
||||
while (!this.signal.aborted) {
|
||||
const job = await this.registry.nextJob(this.signal)
|
||||
if (!job) {
|
||||
return
|
||||
}
|
||||
|
||||
try {
|
||||
await this.runner.execute(job)
|
||||
} catch {
|
||||
// TODO: handle logging of job execution errors
|
||||
} finally {
|
||||
this.registry.markJobAsCompleted(job)
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
36
apps/freya-backend/src/notification/notification-central.ts
Normal file
36
apps/freya-backend/src/notification/notification-central.ts
Normal file
@@ -0,0 +1,36 @@
|
||||
import type { AgentEvent } from "@freya/agent-protocol"
|
||||
|
||||
export interface AgentNotification {
|
||||
kind: "agent"
|
||||
payload: AgentEvent
|
||||
}
|
||||
|
||||
export type NotificationPayload = AgentNotification
|
||||
export type NotificationListener = (notification: NotificationPayload) => Promise<void>
|
||||
|
||||
export class NotificationCentral {
|
||||
private listeners: Map<string, Set<NotificationListener>> = new Map()
|
||||
|
||||
registerListenerForUser(userId: string, listener: NotificationListener): () => void {
|
||||
let listeners = this.listeners.get(userId)
|
||||
if (!listeners) {
|
||||
listeners = new Set()
|
||||
this.listeners.set(userId, listeners)
|
||||
}
|
||||
|
||||
listeners.add(listener)
|
||||
return () => {
|
||||
listeners.delete(listener)
|
||||
if (listeners.size === 0) {
|
||||
this.listeners.delete(userId)
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
async notifyUser(userId: string, notification: NotificationPayload): Promise<void> {
|
||||
const listeners = this.listeners.get(userId)
|
||||
if (!listeners) return
|
||||
|
||||
await Promise.allSettled(Array.from(listeners).map((listener) => listener(notification)))
|
||||
}
|
||||
}
|
||||
@@ -5,12 +5,15 @@ import { createMiddleware } from "hono/factory"
|
||||
import { registerAdminHttpHandlers } from "./admin/http.ts"
|
||||
import { createQueryDebugTools } from "./agent/debug-tools.ts"
|
||||
import { registerAgentHttpHandlers, registerDebugAgentHttpHandlers } from "./agent/http.ts"
|
||||
import { AgentService } from "./agent/service.ts"
|
||||
import { agentWebSocket, registerAgentWebSocketHandlers } from "./agent/ws.ts"
|
||||
import { createRequireAdmin } from "./auth/admin-middleware.ts"
|
||||
import { registerAuthHandlers } from "./auth/http.ts"
|
||||
import { createAuth } from "./auth/index.ts"
|
||||
import { createRequireSession } from "./auth/session-middleware.ts"
|
||||
import { CalDavSourceProvider } from "./caldav/provider.ts"
|
||||
import { registerConversationsHttpHandlers } from "./conversations/http.ts"
|
||||
import { DrizzleConversationStorage } from "./conversations/storage.ts"
|
||||
import { createDatabase } from "./db/index.ts"
|
||||
import { registerFeedHttpHandlers } from "./engine/http.ts"
|
||||
import { createFeedEnhancer } from "./enhancement/enhance-feed.ts"
|
||||
@@ -20,6 +23,7 @@ import { CredentialEncryptor } from "./lib/crypto.ts"
|
||||
import { ensureEnv } from "./lib/env.ts"
|
||||
import { registerLocationHttpHandlers } from "./location/http.ts"
|
||||
import { LocationSourceProvider } from "./location/provider.ts"
|
||||
import { NotificationCentral } from "./notification/notification-central.ts"
|
||||
import { ReminderSourceProvider } from "./reminders/provider.ts"
|
||||
import { UserSessionManager } from "./session/index.ts"
|
||||
import { registerSourcesHttpHandlers } from "./sources/http.ts"
|
||||
@@ -31,8 +35,12 @@ function main() {
|
||||
const env = ensureEnv(process.env)
|
||||
|
||||
const { db, close: closeDb } = createDatabase(env.databaseUrl)
|
||||
const conversationStorage = new DrizzleConversationStorage(db, false)
|
||||
|
||||
const auth = createAuth(db)
|
||||
|
||||
const abortController = new AbortController()
|
||||
|
||||
const feedEnhancer = createFeedEnhancer({
|
||||
client: createLlmClient({
|
||||
apiKey: env.openrouterApiKey,
|
||||
@@ -72,6 +80,15 @@ function main() {
|
||||
console.warn("[query] PI_API_KEY or OPENROUTER_API_KEY not set — query agent unavailable")
|
||||
}
|
||||
|
||||
const notificationCentral = new NotificationCentral()
|
||||
|
||||
const agentService = new AgentService({
|
||||
notificationCentral,
|
||||
storage: conversationStorage,
|
||||
userSessionManager: sessionManager,
|
||||
signal: abortController.signal,
|
||||
})
|
||||
|
||||
const app = new Hono()
|
||||
|
||||
const isDev = process.env.NODE_ENV !== "production"
|
||||
@@ -129,6 +146,7 @@ function main() {
|
||||
sessionManager,
|
||||
authSessionMiddleware,
|
||||
})
|
||||
registerConversationsHttpHandlers(app, { db, authSessionMiddleware })
|
||||
if (isDebugMode) {
|
||||
registerDebugAgentHttpHandlers(app, {
|
||||
authSessionMiddleware,
|
||||
@@ -139,17 +157,22 @@ function main() {
|
||||
registerAdminHttpHandlers(app, { sessionManager, adminMiddleware, db })
|
||||
|
||||
registerAgentWebSocketHandlers(app, {
|
||||
sessionManager,
|
||||
agentService,
|
||||
notificationCentral,
|
||||
storage: conversationStorage,
|
||||
authSessionMiddleware,
|
||||
corsMiddleware: agentWebSocketCorsMiddleware,
|
||||
})
|
||||
|
||||
process.on("SIGTERM", async () => {
|
||||
sessionManager.dispose()
|
||||
abortController.abort()
|
||||
await closeDb()
|
||||
process.exit(0)
|
||||
})
|
||||
|
||||
agentService.start()
|
||||
|
||||
return app
|
||||
}
|
||||
|
||||
|
||||
@@ -1,5 +1,6 @@
|
||||
import type { ActionDefinition, ContextEntry, FeedItem, FeedSource } from "@freya/core"
|
||||
|
||||
import { ConversationEntryKind } from "@freya/core"
|
||||
import { LocationSource } from "@freya/source-location"
|
||||
import { WeatherSource } from "@freya/source-weatherkit"
|
||||
import { beforeEach, describe, expect, mock, spyOn, test } from "bun:test"
|
||||
@@ -9,7 +10,6 @@ import type { AppendConversationEntryInput } from "../conversations/storage.ts"
|
||||
import type { Database } from "../db/index.ts"
|
||||
import type { FeedSourceProvider } from "./feed-source-provider.ts"
|
||||
|
||||
import { ConversationEntryKind } from "../conversations/types.ts"
|
||||
import { CredentialEncryptor } from "../lib/crypto.ts"
|
||||
import {
|
||||
CredentialStorageUnavailableError,
|
||||
@@ -120,7 +120,7 @@ mock.module("../sources/user-sources.ts", () => ({
|
||||
}),
|
||||
}))
|
||||
|
||||
mock.module("../conversations/storage.ts", () => ({
|
||||
mock.module("../conversations/db-storage.ts", () => ({
|
||||
conversations: (_db: Database, userId: string) => ({
|
||||
async getOrCreateConversation(): Promise<{ id: string }> {
|
||||
mockConversationCalls.push({ type: "getOrCreate", userId })
|
||||
|
||||
@@ -8,7 +8,7 @@ import type { FeedEnhancer } from "../enhancement/enhance-feed.ts"
|
||||
import type { CredentialEncryptor } from "../lib/crypto.ts"
|
||||
import type { FeedSourceProvider } from "./feed-source-provider.ts"
|
||||
|
||||
import { conversations } from "../conversations/storage.ts"
|
||||
import { conversations } from "../conversations/db-storage.ts"
|
||||
import {
|
||||
CredentialStorageUnavailableError,
|
||||
InvalidSourceConfigError,
|
||||
|
||||
@@ -1,5 +1,6 @@
|
||||
import type { ActionDefinition, ContextEntry, FeedItem, FeedSource } from "@freya/core"
|
||||
|
||||
import { ConversationEntryKind } from "@freya/core"
|
||||
import { LocationSource } from "@freya/source-location"
|
||||
import { describe, expect, spyOn, test } from "bun:test"
|
||||
|
||||
@@ -9,7 +10,6 @@ import type {
|
||||
} from "../agent/conversation-recording-query-agent.ts"
|
||||
import type { AppendConversationEntryInput } from "../conversations/storage.ts"
|
||||
|
||||
import { ConversationEntryKind } from "../conversations/types.ts"
|
||||
import { UserSession } from "./user-session.ts"
|
||||
|
||||
function createStubSource(id: string, items: FeedItem[] = []): FeedSource {
|
||||
|
||||
@@ -263,18 +263,12 @@ export class UserSession {
|
||||
const conversation = await conversationStorage.getOrCreateConversation()
|
||||
const entries = await conversationStorage.listEntries(conversation.id)
|
||||
|
||||
this.queryAgent = new ConversationRecordingQueryAgent({
|
||||
agent: new PiQueryAgent({
|
||||
this.queryAgent = new PiQueryAgent({
|
||||
toolbox: this.toolbox,
|
||||
apiKey: this.agentConfig?.apiKey,
|
||||
cwd: this.agentConfig?.cwd,
|
||||
systemPrompt: this.agentConfig?.systemPrompt,
|
||||
initialEntries: entries,
|
||||
}),
|
||||
storage: conversationStorage,
|
||||
defaultConversationId: conversation.id,
|
||||
modelProvider: PI_MODEL_PROVIDER,
|
||||
modelId: PI_MODEL_ID,
|
||||
})
|
||||
}
|
||||
|
||||
|
||||
@@ -128,7 +128,7 @@ mock.module("../sources/user-sources.ts", () => ({
|
||||
},
|
||||
}))
|
||||
|
||||
mock.module("../conversations/storage.ts", () => ({
|
||||
mock.module("../conversations/db-storage.ts", () => ({
|
||||
conversations: (_db: Database, userId: string) => ({
|
||||
async getOrCreateConversation() {
|
||||
return { id: `conversation-${userId}` }
|
||||
|
||||
@@ -1,13 +1,12 @@
|
||||
{
|
||||
"expo": {
|
||||
"name": "Freya",
|
||||
"slug": "freya-client",
|
||||
"slug": "freya",
|
||||
"version": "1.0.0",
|
||||
"orientation": "portrait",
|
||||
"icon": "./assets/images/icon.png",
|
||||
"scheme": "freya",
|
||||
"userInterfaceStyle": "automatic",
|
||||
"newArchEnabled": true,
|
||||
"ios": {
|
||||
"infoPlist": {
|
||||
"NSAppTransportSecurity": {
|
||||
@@ -24,7 +23,6 @@
|
||||
"backgroundImage": "./assets/images/android-icon-background.png",
|
||||
"monochromeImage": "./assets/images/android-icon-monochrome.png"
|
||||
},
|
||||
"edgeToEdgeEnabled": true,
|
||||
"predictiveBackGestureEnabled": false,
|
||||
"package": "sh.nym.freya"
|
||||
},
|
||||
@@ -54,55 +52,82 @@
|
||||
{
|
||||
"fontFamily": "Inter",
|
||||
"fontDefinitions": [
|
||||
{ "path": "./assets/fonts/Inter_100Thin.ttf", "weight": 100 },
|
||||
{
|
||||
"path": "./assets/fonts/Inter_100Thin.ttf",
|
||||
"weight": 100
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/Inter_100Thin_Italic.ttf",
|
||||
"weight": 100,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/Inter_200ExtraLight.ttf", "weight": 200 },
|
||||
{
|
||||
"path": "./assets/fonts/Inter_200ExtraLight.ttf",
|
||||
"weight": 200
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/Inter_200ExtraLight_Italic.ttf",
|
||||
"weight": 200,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/Inter_300Light.ttf", "weight": 300 },
|
||||
{
|
||||
"path": "./assets/fonts/Inter_300Light.ttf",
|
||||
"weight": 300
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/Inter_300Light_Italic.ttf",
|
||||
"weight": 300,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/Inter_400Regular.ttf", "weight": 400 },
|
||||
{
|
||||
"path": "./assets/fonts/Inter_400Regular.ttf",
|
||||
"weight": 400
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/Inter_400Regular_Italic.ttf",
|
||||
"weight": 400,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/Inter_500Medium.ttf", "weight": 500 },
|
||||
{
|
||||
"path": "./assets/fonts/Inter_500Medium.ttf",
|
||||
"weight": 500
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/Inter_500Medium_Italic.ttf",
|
||||
"weight": 500,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/Inter_600SemiBold.ttf", "weight": 600 },
|
||||
{
|
||||
"path": "./assets/fonts/Inter_600SemiBold.ttf",
|
||||
"weight": 600
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/Inter_600SemiBold_Italic.ttf",
|
||||
"weight": 600,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/Inter_700Bold.ttf", "weight": 700 },
|
||||
{
|
||||
"path": "./assets/fonts/Inter_700Bold.ttf",
|
||||
"weight": 700
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/Inter_700Bold_Italic.ttf",
|
||||
"weight": 700,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/Inter_800ExtraBold.ttf", "weight": 800 },
|
||||
{
|
||||
"path": "./assets/fonts/Inter_800ExtraBold.ttf",
|
||||
"weight": 800
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/Inter_800ExtraBold_Italic.ttf",
|
||||
"weight": 800,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/Inter_900Black.ttf", "weight": 900 },
|
||||
{
|
||||
"path": "./assets/fonts/Inter_900Black.ttf",
|
||||
"weight": 900
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/Inter_900Black_Italic.ttf",
|
||||
"weight": 900,
|
||||
@@ -113,49 +138,73 @@
|
||||
{
|
||||
"fontFamily": "Source Serif 4",
|
||||
"fontDefinitions": [
|
||||
{ "path": "./assets/fonts/SourceSerif4_200ExtraLight.ttf", "weight": 200 },
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_200ExtraLight.ttf",
|
||||
"weight": 200
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_200ExtraLight_Italic.ttf",
|
||||
"weight": 200,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/SourceSerif4_300Light.ttf", "weight": 300 },
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_300Light.ttf",
|
||||
"weight": 300
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_300Light_Italic.ttf",
|
||||
"weight": 300,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/SourceSerif4_400Regular.ttf", "weight": 400 },
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_400Regular.ttf",
|
||||
"weight": 400
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_400Regular_Italic.ttf",
|
||||
"weight": 400,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/SourceSerif4_500Medium.ttf", "weight": 500 },
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_500Medium.ttf",
|
||||
"weight": 500
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_500Medium_Italic.ttf",
|
||||
"weight": 500,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/SourceSerif4_600SemiBold.ttf", "weight": 600 },
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_600SemiBold.ttf",
|
||||
"weight": 600
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_600SemiBold_Italic.ttf",
|
||||
"weight": 600,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/SourceSerif4_700Bold.ttf", "weight": 700 },
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_700Bold.ttf",
|
||||
"weight": 700
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_700Bold_Italic.ttf",
|
||||
"weight": 700,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/SourceSerif4_800ExtraBold.ttf", "weight": 800 },
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_800ExtraBold.ttf",
|
||||
"weight": 800
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_800ExtraBold_Italic.ttf",
|
||||
"weight": 800,
|
||||
"style": "italic"
|
||||
},
|
||||
{ "path": "./assets/fonts/SourceSerif4_900Black.ttf", "weight": 900 },
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_900Black.ttf",
|
||||
"weight": 900
|
||||
},
|
||||
{
|
||||
"path": "./assets/fonts/SourceSerif4_900Black_Italic.ttf",
|
||||
"weight": 900,
|
||||
@@ -204,7 +253,9 @@
|
||||
]
|
||||
}
|
||||
}
|
||||
]
|
||||
],
|
||||
"expo-web-browser",
|
||||
"expo-image"
|
||||
],
|
||||
"experiments": {
|
||||
"typedRoutes": true,
|
||||
@@ -213,7 +264,7 @@
|
||||
"extra": {
|
||||
"router": {},
|
||||
"eas": {
|
||||
"projectId": "61092d23-36aa-418e-929d-ea40dc912e8f"
|
||||
"projectId": "c54ea4e5-27da-4066-b081-db8005ecf70a"
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
@@ -10,8 +10,8 @@
|
||||
"ios": "expo start --ios",
|
||||
"web": "expo start --web",
|
||||
"lint": "expo lint",
|
||||
"build:ios": "eas build --profile development --platform ios --non-interactive",
|
||||
"build:ios-simulator": "eas build --profile development-simulator --platform ios --non-interactive",
|
||||
"build:ios": "bunx eas-cli build --profile development --platform ios --non-interactive",
|
||||
"build:ios-simulator": "bunx eas-cli build --profile development-simulator --platform ios --non-interactive",
|
||||
"debugger": "bun run scripts/open-debugger.ts"
|
||||
},
|
||||
"dependencies": {
|
||||
@@ -19,42 +19,38 @@
|
||||
"@expo-google-fonts/source-serif-4": "^0.4.1",
|
||||
"@expo/vector-icons": "^15.0.3",
|
||||
"@json-render/react-native": "^0.13.0",
|
||||
"@react-navigation/bottom-tabs": "^7.4.0",
|
||||
"@react-navigation/elements": "^2.6.3",
|
||||
"@react-navigation/native": "^7.1.8",
|
||||
"@tanstack/react-query": "^5.90.21",
|
||||
"expo": "~54.0.33",
|
||||
"expo-constants": "~18.0.13",
|
||||
"expo-dev-client": "~6.0.20",
|
||||
"expo-font": "~14.0.11",
|
||||
"expo-haptics": "~15.0.8",
|
||||
"expo-image": "~3.0.11",
|
||||
"expo-linking": "~8.0.11",
|
||||
"expo-location": "~19.0.8",
|
||||
"expo-router": "~6.0.23",
|
||||
"expo-splash-screen": "~31.0.13",
|
||||
"expo-status-bar": "~3.0.9",
|
||||
"expo-symbols": "~1.0.8",
|
||||
"expo-system-ui": "~6.0.9",
|
||||
"expo-web-browser": "~15.0.10",
|
||||
"react": "19.1.0",
|
||||
"react-dom": "19.1.0",
|
||||
"react-native": "0.81.5",
|
||||
"react-native-gesture-handler": "~2.28.0",
|
||||
"react-native-reanimated": "~4.1.1",
|
||||
"react-native-safe-area-context": "~5.6.0",
|
||||
"react-native-screens": "~4.16.0",
|
||||
"react-native-svg": "15.12.1",
|
||||
"expo": "^56.0.0",
|
||||
"expo-constants": "~56.0.18",
|
||||
"expo-dev-client": "~56.0.20",
|
||||
"expo-font": "~56.0.7",
|
||||
"expo-haptics": "~56.0.3",
|
||||
"expo-image": "~56.0.11",
|
||||
"expo-linking": "~56.0.14",
|
||||
"expo-location": "~56.0.18",
|
||||
"expo-router": "~56.2.11",
|
||||
"expo-splash-screen": "~56.0.10",
|
||||
"expo-status-bar": "~56.0.4",
|
||||
"expo-symbols": "~56.0.6",
|
||||
"expo-system-ui": "~56.0.5",
|
||||
"expo-web-browser": "~56.0.5",
|
||||
"react": "19.2.3",
|
||||
"react-dom": "19.2.3",
|
||||
"react-native": "0.85.3",
|
||||
"react-native-gesture-handler": "~2.31.1",
|
||||
"react-native-reanimated": "4.3.1",
|
||||
"react-native-safe-area-context": "~5.7.0",
|
||||
"react-native-screens": "4.25.2",
|
||||
"react-native-svg": "15.15.4",
|
||||
"react-native-web": "~0.21.0",
|
||||
"react-native-worklets": "0.5.1",
|
||||
"react-native-worklets": "0.8.3",
|
||||
"twrnc": "^4.16.0",
|
||||
"zod": "^4.3.6"
|
||||
},
|
||||
"devDependencies": {
|
||||
"@types/react": "~19.1.0",
|
||||
"eas-cli": "^18.0.1",
|
||||
"@types/react": "~19.2.10",
|
||||
"eslint": "^9.25.0",
|
||||
"eslint-config-expo": "~10.0.0",
|
||||
"typescript": "^6"
|
||||
"eslint-config-expo": "~56.0.4",
|
||||
"typescript": "~6.0.3"
|
||||
}
|
||||
}
|
||||
|
||||
@@ -8,14 +8,16 @@ import type { ServerWebSocket } from "bun"
|
||||
|
||||
const PROXY_PORT = parseInt(process.env.PROXY_PORT || "8080", 10)
|
||||
const PROXY_HOST = process.env.PROXY_HOST || "0.0.0.0"
|
||||
const METRO_HOST = process.env.METRO_HOST || "localhost"
|
||||
const METRO_PORT = parseInt(process.env.METRO_PORT || "8081", 10)
|
||||
const METRO_BASE = `http://127.0.0.1:${METRO_PORT}`
|
||||
const METRO_BASE = `http://${METRO_HOST}:${METRO_PORT}`
|
||||
const METRO_WS_BASE = `ws://${METRO_HOST}:${METRO_PORT}`
|
||||
|
||||
function forwardHeaders(headers: Headers): Headers {
|
||||
const result = new Headers(headers)
|
||||
result.delete("origin")
|
||||
result.delete("referer")
|
||||
result.set("host", `127.0.0.1:${METRO_PORT}`)
|
||||
result.set("host", `${METRO_HOST}:${METRO_PORT}`)
|
||||
return result
|
||||
}
|
||||
|
||||
@@ -40,7 +42,7 @@ Bun.serve<WsData>({
|
||||
|
||||
// WebSocket upgrade — bridge to Metro's ws endpoint
|
||||
if (req.headers.get("upgrade")?.toLowerCase() === "websocket") {
|
||||
const wsUrl = `ws://127.0.0.1:${METRO_PORT}${url.pathname}${url.search}`
|
||||
const wsUrl = `${METRO_WS_BASE}${url.pathname}${url.search}`
|
||||
const upstream = new WebSocket(wsUrl)
|
||||
|
||||
// Wait for upstream to connect before upgrading the client
|
||||
@@ -65,12 +67,12 @@ Bun.serve<WsData>({
|
||||
// HTTP proxy
|
||||
const upstream = `${METRO_BASE}${url.pathname}${url.search}`
|
||||
const body = req.body ? await req.arrayBuffer() : undefined
|
||||
const res = await fetch(upstream, {
|
||||
method: req.method,
|
||||
headers: forwardHeaders(req.headers),
|
||||
body,
|
||||
redirect: "manual",
|
||||
const res = await fetchUpstream(upstream, req.method, forwardHeaders(req.headers), body)
|
||||
if (res == null) {
|
||||
return new Response(`Metro is not reachable on ${METRO_HOST}. Restart the Expo dev server.`, {
|
||||
status: 502,
|
||||
})
|
||||
}
|
||||
|
||||
return new Response(res.body, {
|
||||
status: res.status,
|
||||
@@ -121,9 +123,7 @@ async function printDebuggerUrl() {
|
||||
const target = targets.find((t) => t.reactNative?.capabilities?.prefersFuseboxFrontend)
|
||||
if (!target) return
|
||||
|
||||
const wsPath = target.webSocketDebuggerUrl
|
||||
.replace(/^ws:\/\//, "")
|
||||
.replace(`127.0.0.1:${METRO_PORT}`, `${tsIp}:${PROXY_PORT}`)
|
||||
const wsPath = getProxyWebSocketPath(target.webSocketDebuggerUrl)
|
||||
|
||||
console.log(
|
||||
`\n React Native DevTools:\n ${base}/debugger-frontend/rn_fusebox.html?ws=${encodeURIComponent(wsPath)}&sources.hide_add_folder=true&unstable_enableNetworkPanel=true\n`,
|
||||
@@ -131,9 +131,28 @@ async function printDebuggerUrl() {
|
||||
}
|
||||
|
||||
console.log(
|
||||
`[proxy] listening on ${PROXY_HOST}:${PROXY_PORT}, forwarding to 127.0.0.1:${METRO_PORT}`,
|
||||
`[proxy] listening on ${PROXY_HOST}:${PROXY_PORT}, forwarding to ${METRO_HOST}:${METRO_PORT}`,
|
||||
)
|
||||
|
||||
async function fetchUpstream(
|
||||
upstream: string,
|
||||
method: string,
|
||||
headers: Headers,
|
||||
body: ArrayBuffer | undefined,
|
||||
) {
|
||||
try {
|
||||
return await fetch(upstream, {
|
||||
method,
|
||||
headers,
|
||||
body,
|
||||
redirect: "manual",
|
||||
})
|
||||
} catch {
|
||||
console.error(`[proxy] ${method} ${upstream} failed; Metro is not reachable`)
|
||||
return null
|
||||
}
|
||||
}
|
||||
|
||||
function isDebugTarget(value: unknown): value is DebugTarget {
|
||||
if (!isRecord(value) || typeof value.webSocketDebuggerUrl !== "string") return false
|
||||
|
||||
@@ -149,6 +168,11 @@ function isDebugTarget(value: unknown): value is DebugTarget {
|
||||
return prefersFuseboxFrontend === undefined || typeof prefersFuseboxFrontend === "boolean"
|
||||
}
|
||||
|
||||
function getProxyWebSocketPath(webSocketDebuggerUrl: string) {
|
||||
const url = new URL(webSocketDebuggerUrl)
|
||||
return `${tsIp}:${PROXY_PORT}${url.pathname}${url.search}`
|
||||
}
|
||||
|
||||
function isRecord(value: unknown): value is Record<string, unknown> {
|
||||
return typeof value === "object" && value !== null
|
||||
}
|
||||
|
||||
@@ -4,7 +4,6 @@
|
||||
import { $ } from "bun"
|
||||
|
||||
const PROXY_PORT = process.env.PROXY_PORT || "8080"
|
||||
const METRO_PORT = process.env.METRO_PORT || "8081"
|
||||
const tsIp = (await $`tailscale ip -4`.text()).trim()
|
||||
const base = `http://${tsIp}:${PROXY_PORT}`
|
||||
|
||||
@@ -37,9 +36,7 @@ if (!target) {
|
||||
process.exit(1)
|
||||
}
|
||||
|
||||
const wsUrl = target.webSocketDebuggerUrl
|
||||
.replace(/^ws:\/\//, "")
|
||||
.replace(`127.0.0.1:${METRO_PORT}`, `${tsIp}:${PROXY_PORT}`)
|
||||
const wsUrl = getProxyWebSocketPath(target.webSocketDebuggerUrl)
|
||||
|
||||
const url = `${base}/debugger-frontend/rn_fusebox.html?ws=${encodeURIComponent(wsUrl)}&sources.hide_add_folder=true&unstable_enableNetworkPanel=true`
|
||||
|
||||
@@ -71,6 +68,11 @@ function isDebugTarget(value: unknown): value is DebugTarget {
|
||||
return prefersFuseboxFrontend === undefined || typeof prefersFuseboxFrontend === "boolean"
|
||||
}
|
||||
|
||||
function getProxyWebSocketPath(webSocketDebuggerUrl: string) {
|
||||
const url = new URL(webSocketDebuggerUrl)
|
||||
return `${tsIp}:${PROXY_PORT}${url.pathname}${url.search}`
|
||||
}
|
||||
|
||||
function isRecord(value: unknown): value is Record<string, unknown> {
|
||||
return typeof value === "object" && value !== null
|
||||
}
|
||||
|
||||
@@ -1,14 +1,47 @@
|
||||
#!/usr/bin/env bash
|
||||
set -euo pipefail
|
||||
|
||||
PROXY_PORT=8080
|
||||
METRO_PORT=8081
|
||||
PROXY_PORT=${PROXY_PORT:-8080}
|
||||
METRO_HOST=${METRO_HOST:-localhost}
|
||||
METRO_PORT=${METRO_PORT:-8081}
|
||||
TS_IP=$(tailscale ip -4)
|
||||
|
||||
# Start a reverse proxy so Metro sees all requests as loopback.
|
||||
# This makes debugger endpoints (/debugger-frontend, /json, /open-debugger)
|
||||
# accessible through the Tailscale IP.
|
||||
PROXY_PORT=$PROXY_PORT METRO_PORT=$METRO_PORT bun run scripts/dev-proxy.ts &
|
||||
port_is_open() {
|
||||
(: >"/dev/tcp/$1/$2") >/dev/null 2>&1
|
||||
}
|
||||
|
||||
ensure_port_available() {
|
||||
local port=$1
|
||||
local name=$2
|
||||
|
||||
if port_is_open localhost "$port"; then
|
||||
echo "$name port $port is already in use." >&2
|
||||
echo "Stop the existing process or set ${name}_PORT to another value." >&2
|
||||
exit 1
|
||||
fi
|
||||
}
|
||||
|
||||
wait_for_metro() {
|
||||
for _ in {1..120}; do
|
||||
if port_is_open "$METRO_HOST" "$METRO_PORT"; then
|
||||
return 0
|
||||
fi
|
||||
sleep 0.5
|
||||
done
|
||||
|
||||
echo "Metro did not start on ${METRO_HOST}:${METRO_PORT}." >&2
|
||||
return 1
|
||||
}
|
||||
|
||||
ensure_port_available "$PROXY_PORT" PROXY
|
||||
ensure_port_available "$METRO_PORT" METRO
|
||||
|
||||
# Start the proxy only after Metro is listening. Otherwise an iOS client can hit
|
||||
# the proxy during Expo startup and get a misleading upstream connection error.
|
||||
(
|
||||
wait_for_metro
|
||||
exec env PROXY_PORT=$PROXY_PORT METRO_HOST=$METRO_HOST METRO_PORT=$METRO_PORT bun run scripts/dev-proxy.ts
|
||||
) &
|
||||
PROXY_PID=$!
|
||||
trap "kill $PROXY_PID 2>/dev/null" EXIT
|
||||
|
||||
|
||||
@@ -1,5 +1,5 @@
|
||||
import Feather from "@expo/vector-icons/Feather"
|
||||
import { type PressableProps, Pressable, View } from "react-native"
|
||||
import { type PressableProps, Pressable, type StyleProp, View, type ViewStyle } from "react-native"
|
||||
import tw from "twrnc"
|
||||
|
||||
import { SansSerifText } from "./sans-serif-text"
|
||||
@@ -14,9 +14,10 @@ function ButtonIcon({ name }: ButtonIconProps) {
|
||||
return <Feather name={name} size={18} color={tw.color("text-stone-100 dark:text-stone-200")} />
|
||||
}
|
||||
|
||||
type ButtonProps = Omit<PressableProps, "children"> & {
|
||||
type ButtonProps = Omit<PressableProps, "children" | "style"> & {
|
||||
label: string
|
||||
leadingIcon?: React.ReactNode
|
||||
style?: StyleProp<ViewStyle>
|
||||
trailingIcon?: React.ReactNode
|
||||
}
|
||||
|
||||
|
||||
@@ -16,9 +16,9 @@
|
||||
"lottie-react": "^2.4.1",
|
||||
"lucide-react": "^0.577.0",
|
||||
"motion": "^12.35.0",
|
||||
"react": "^19.2.4",
|
||||
"react": "19.2.3",
|
||||
"react-aria-components": "^1.16.0",
|
||||
"react-dom": "^19.2.4",
|
||||
"react-dom": "19.2.3",
|
||||
"react-router": "7.12.0",
|
||||
"resend": "^6.9.3",
|
||||
"streamdown": "^2.4.0"
|
||||
|
||||
2
bunfig.toml
Normal file
2
bunfig.toml
Normal file
@@ -0,0 +1,2 @@
|
||||
[install]
|
||||
linker = "hoisted"
|
||||
15
flake.nix
15
flake.nix
@@ -45,7 +45,7 @@
|
||||
# node_modules is content-addressed. If bun.lock or package manifests
|
||||
# change, Nix will report the new hash to put here.
|
||||
nodeModulesHashes = {
|
||||
x86_64-linux = "sha256-apVZaFGf9OKpil1WdcQ1CJODsIdjLWlBBZErHg5mjZA=";
|
||||
x86_64-linux = "sha256-8uhlaQAFfCgGdUlrz8sqhtIkC/WfdasbTCi3p/NkU/w=";
|
||||
};
|
||||
checkSystems = lib.attrNames nodeModulesHashes;
|
||||
|
||||
@@ -53,7 +53,10 @@
|
||||
# so source-only edits do not force Bun to reinstall.
|
||||
dependencySource = lib.fileset.toSource {
|
||||
root = ./.;
|
||||
fileset = lib.fileset.fileFilter (file: file.name == "bun.lock" || file.name == "package.json") ./.;
|
||||
fileset = lib.fileset.fileFilter
|
||||
(
|
||||
file: file.name == "bun.lock" || file.name == "package.json" || file.name == "bunfig.toml"
|
||||
) ./.;
|
||||
};
|
||||
|
||||
# Checks run against a clean source tree, even when using `path:.`.
|
||||
@@ -90,10 +93,12 @@
|
||||
lib.mapAttrs mkBunScript scripts;
|
||||
mkBunApps =
|
||||
commands:
|
||||
lib.mapAttrs (name: command: {
|
||||
lib.mapAttrs
|
||||
(name: command: {
|
||||
type = "app";
|
||||
program = "${command}/bin/${name}";
|
||||
}) commands;
|
||||
})
|
||||
commands;
|
||||
mkBunNodeModules =
|
||||
system: pkgs:
|
||||
pkgs.stdenvNoCC.mkDerivation {
|
||||
@@ -243,6 +248,7 @@
|
||||
bunScriptCommands = lib.attrValues (mkBunScriptCommands pkgs shellScripts);
|
||||
commonPackages = with pkgs; [
|
||||
bun
|
||||
eas-cli
|
||||
git
|
||||
gh
|
||||
gnumake
|
||||
@@ -252,6 +258,7 @@
|
||||
pkg-config
|
||||
postgresql
|
||||
python3
|
||||
typescript-go
|
||||
watchman
|
||||
];
|
||||
linuxPackages = with pkgs; [
|
||||
|
||||
@@ -10,6 +10,7 @@
|
||||
"expo": "cd apps/freya-client && bun run start",
|
||||
"drizzle-studio": "TS_IP=$(tailscale ip -4); echo \"Drizzle Studio: https://local.drizzle.studio/?host=${TS_IP}&port=4983\"; cd apps/freya-backend && bunx drizzle-kit studio --host 0.0.0.0 --port 4983",
|
||||
"freya-backend": "TS_IP=$(tailscale ip -4); echo \"Freya Backend: http://${TS_IP}:3000\"; echo \"\"; echo \"------------------ Bun Debugger ------------------\"; echo \"https://debug.bun.sh/#${TS_IP}:6499\"; echo \"------------------ Bun Debugger ------------------\"; echo \"\"; cd apps/freya-backend && bun run dev",
|
||||
"client": "bun run --elide-lines=0 --filter freya-client start",
|
||||
"admin-dashboard": "TS_IP=$(tailscale ip -4); echo \"Admin Dashboard: http://${TS_IP}:5174\"; cd apps/admin-dashboard && bun run dev --host 0.0.0.0",
|
||||
"agent-test-cli": "cd apps/agent-test-cli && bun run start",
|
||||
"test": "bun run --filter '*' test",
|
||||
|
||||
@@ -1,8 +1,3 @@
|
||||
export interface SendMessageResult {
|
||||
message: string
|
||||
conversationId: string
|
||||
}
|
||||
|
||||
export type AgentEvent =
|
||||
| { type: "conversation_started"; conversationId: string }
|
||||
| { type: "message_created"; text: string }
|
||||
@@ -11,8 +6,11 @@ export type AgentEvent =
|
||||
| { type: "message_finished" }
|
||||
| { type: "message_failed"; error: string }
|
||||
|
||||
export type UserEvent = { type: "typing" }
|
||||
|
||||
export interface AgentServerApi {
|
||||
sendMessage(message: string): Promise<SendMessageResult>
|
||||
sendMessage(message: string): Promise<boolean>
|
||||
notify(event: UserEvent): void
|
||||
ping(): "pong"
|
||||
}
|
||||
|
||||
|
||||
@@ -8,7 +8,8 @@
|
||||
"test": "bun test ."
|
||||
},
|
||||
"dependencies": {
|
||||
"@standard-schema/spec": "^1.1.0"
|
||||
"@standard-schema/spec": "^1.1.0",
|
||||
"arktype": "^2.1.29"
|
||||
},
|
||||
"peerDependencies": {
|
||||
"@json-render/core": "*",
|
||||
|
||||
@@ -7,7 +7,7 @@ import {
|
||||
ConversationEntryMetadata,
|
||||
GenericObjectPayload,
|
||||
UserMessagePayload,
|
||||
} from "./types.ts"
|
||||
} from "./conversation"
|
||||
|
||||
describe("conversation entry schemas", () => {
|
||||
test("parses valid user message payloads", () => {
|
||||
@@ -1,5 +1,6 @@
|
||||
import { type } from "arktype"
|
||||
|
||||
/** Entry kinds supported by the persisted conversation timeline. */
|
||||
export const ConversationEntryKind = {
|
||||
UserMessage: "user_message",
|
||||
AssistantMessage: "assistant_message",
|
||||
@@ -10,17 +11,21 @@ export const ConversationEntryKind = {
|
||||
SystemNote: "system_note",
|
||||
} as const
|
||||
|
||||
/** Discriminator for the payload shape and handling of a conversation entry. */
|
||||
export type ConversationEntryKind =
|
||||
(typeof ConversationEntryKind)[keyof typeof ConversationEntryKind]
|
||||
|
||||
/** Visibility scopes supported by stored conversation entries. */
|
||||
export const ConversationEntryVisibility = {
|
||||
UserVisible: "user_visible",
|
||||
Internal: "internal",
|
||||
} as const
|
||||
|
||||
/** Indicates whether a conversation entry should be exposed to the user. */
|
||||
export type ConversationEntryVisibility =
|
||||
(typeof ConversationEntryVisibility)[keyof typeof ConversationEntryVisibility]
|
||||
|
||||
/** Attachment media categories accepted by conversation entries. */
|
||||
export const AttachmentType = {
|
||||
Image: "image",
|
||||
Audio: "audio",
|
||||
@@ -29,57 +34,64 @@ export const AttachmentType = {
|
||||
Other: "other",
|
||||
} as const
|
||||
|
||||
/** File or media category associated with an attachment payload. */
|
||||
export type AttachmentType = (typeof AttachmentType)[keyof typeof AttachmentType]
|
||||
|
||||
export const ConversationEntryKindInput = type.enumerated(...Object.values(ConversationEntryKind))
|
||||
export const ConversationEntryVisibilityInput = type.enumerated(
|
||||
...Object.values(ConversationEntryVisibility),
|
||||
)
|
||||
export const AttachmentTypeInput = type.enumerated(...Object.values(AttachmentType))
|
||||
|
||||
const TextMessagePart = type({
|
||||
/** Plain text content part for a message. */
|
||||
export const TextMessagePart = type({
|
||||
"+": "reject",
|
||||
type: "'text'",
|
||||
text: "string",
|
||||
})
|
||||
|
||||
const JsonMessagePart = type({
|
||||
/** Structured JSON content part for a message. */
|
||||
export const JsonMessagePart = type({
|
||||
"+": "reject",
|
||||
type: "'json'",
|
||||
value: "unknown",
|
||||
})
|
||||
|
||||
/** Content part variants supported by user and assistant messages. */
|
||||
export const MessagePart = type.or(TextMessagePart, JsonMessagePart)
|
||||
|
||||
/** A structured content part inside a user or assistant message payload. */
|
||||
export type MessagePart = typeof MessagePart.infer
|
||||
|
||||
/** User-authored message entry payload. */
|
||||
export const UserMessagePayload = type({
|
||||
"+": "reject",
|
||||
role: "'user'",
|
||||
parts: MessagePart.array().atLeastLength(1),
|
||||
})
|
||||
|
||||
/** Payload stored for a conversation entry containing a user message. */
|
||||
export type UserMessagePayload = typeof UserMessagePayload.infer
|
||||
|
||||
/** Assistant-authored message entry payload. */
|
||||
export const AssistantMessagePayload = type({
|
||||
"+": "reject",
|
||||
role: "'assistant'",
|
||||
parts: MessagePart.array().atLeastLength(1),
|
||||
})
|
||||
|
||||
/** Payload stored for a conversation entry containing an assistant message. */
|
||||
export type AssistantMessagePayload = typeof AssistantMessagePayload.infer
|
||||
|
||||
/** Attachment entry payload. */
|
||||
export const AttachmentPayload = type({
|
||||
"+": "reject",
|
||||
role: type.enumerated("user", "assistant"),
|
||||
name: "string",
|
||||
mimeType: "string",
|
||||
attachmentType: AttachmentTypeInput,
|
||||
attachmentType: type.enumerated(...Object.values(AttachmentType)),
|
||||
"caption?": "string",
|
||||
})
|
||||
|
||||
/** Payload stored for a conversation entry that references an uploaded file. */
|
||||
export type AttachmentPayload = typeof AttachmentPayload.infer
|
||||
|
||||
const ContextSummary = type({
|
||||
/** Durable facts extracted from compacted conversation history. */
|
||||
export const ContextSummary = type({
|
||||
"+": "reject",
|
||||
"userIntent?": "string",
|
||||
durableFacts: type.string.array(),
|
||||
@@ -89,6 +101,10 @@ const ContextSummary = type({
|
||||
importantDetails: type.string.array(),
|
||||
})
|
||||
|
||||
/** Durable facts and follow-ups retained from compacted conversation history. */
|
||||
export type ContextSummary = typeof ContextSummary.infer
|
||||
|
||||
/** Context-summary conversation entry payload. */
|
||||
export const ContextSummaryPayload = type({
|
||||
"+": "reject",
|
||||
covers: type({
|
||||
@@ -101,8 +117,10 @@ export const ContextSummaryPayload = type({
|
||||
"sourceEntryIds?": type.string.array(),
|
||||
})
|
||||
|
||||
/** Payload describing a compaction summary and the sequence range it covers. */
|
||||
export type ContextSummaryPayload = typeof ContextSummaryPayload.infer
|
||||
|
||||
/** Model invocation metadata recorded on generated entries. */
|
||||
export const ModelRunMetadata = type({
|
||||
"+": "reject",
|
||||
route: "string",
|
||||
@@ -116,21 +134,43 @@ export const ModelRunMetadata = type({
|
||||
"providerRequestId?": "string",
|
||||
})
|
||||
|
||||
/** Metadata describing the model run that produced a conversation entry. */
|
||||
export type ModelRunMetadata = typeof ModelRunMetadata.infer
|
||||
|
||||
/** Arbitrary metadata stored alongside conversation entries. */
|
||||
export const ConversationEntryMetadata = type({
|
||||
"modelRun?": ModelRunMetadata,
|
||||
"[string]": "unknown",
|
||||
})
|
||||
|
||||
/** Metadata bag attached to a conversation entry. */
|
||||
export type ConversationEntryMetadata = typeof ConversationEntryMetadata.infer
|
||||
|
||||
export const ToolCallPayload = type({
|
||||
toolName: "string",
|
||||
})
|
||||
|
||||
export type ToolCallPayload = typeof ToolCallPayload.infer
|
||||
|
||||
export const ToolResultPayload = type({
|
||||
toolName: "string",
|
||||
ok: "boolean",
|
||||
})
|
||||
|
||||
export type ToolResultPayload = typeof ToolResultPayload.infer
|
||||
|
||||
/** Generic object payload used by operational entries. */
|
||||
export const GenericObjectPayload = type("Record<string, unknown>")
|
||||
|
||||
/** Fallback payload shape for tool calls, tool results, and system notes. */
|
||||
export type GenericObjectPayload = typeof GenericObjectPayload.infer
|
||||
|
||||
/** Union of payload shapes that can be stored on a conversation entry. */
|
||||
export type ConversationEntryPayload =
|
||||
| UserMessagePayload
|
||||
| AssistantMessagePayload
|
||||
| AttachmentPayload
|
||||
| ContextSummaryPayload
|
||||
| ToolCallPayload
|
||||
| ToolResultPayload
|
||||
| GenericObjectPayload
|
||||
@@ -6,6 +6,27 @@ export { Context, contextKey, serializeKey } from "./context"
|
||||
export type { ActionDefinition } from "./action"
|
||||
export { UnknownActionError } from "./action"
|
||||
|
||||
// Conversation
|
||||
export type { ConversationEntryPayload } from "./conversation"
|
||||
export {
|
||||
AssistantMessagePayload,
|
||||
AttachmentPayload,
|
||||
AttachmentType,
|
||||
ContextSummary,
|
||||
ContextSummaryPayload,
|
||||
ConversationEntryKind,
|
||||
ConversationEntryMetadata,
|
||||
ConversationEntryVisibility,
|
||||
GenericObjectPayload,
|
||||
JsonMessagePart,
|
||||
MessagePart,
|
||||
ModelRunMetadata,
|
||||
TextMessagePart,
|
||||
UserMessagePayload,
|
||||
ToolCallPayload,
|
||||
ToolResultPayload,
|
||||
} from "./conversation"
|
||||
|
||||
// Feed
|
||||
export type { FeedItem, FeedItemRenderer, FeedItemSignals, RenderedFeedItem, Slot } from "./feed"
|
||||
export { TimeRelevance } from "./feed"
|
||||
|
||||
11
skills-lock.json
Normal file
11
skills-lock.json
Normal file
@@ -0,0 +1,11 @@
|
||||
{
|
||||
"version": 1,
|
||||
"skills": {
|
||||
"upgrading-expo": {
|
||||
"source": "expo/skills",
|
||||
"sourceType": "github",
|
||||
"skillPath": "plugins/expo/skills/upgrading-expo/SKILL.md",
|
||||
"computedHash": "98d228925a442126789d90783fdd4ae5de33ab690024b575698057d2ffc44b40"
|
||||
}
|
||||
}
|
||||
}
|
||||
Reference in New Issue
Block a user