Show current queue, accounts, credits, evaluations, and admin users.
Quick Start
Admin is the control center for Jymni Ethics Advisor. It shows system health, user activity, credits, model usage, and rules that shape evaluations.
-
Open
/admin. You must be signed in with an admin role. - Check the summary cards. Look for pending requests, total users, credits outstanding, and recent evaluation volume.
- Use the tabs. Each tab controls one area, such as Users, LLM, Rate Card, Evaluation Specs, or Policy.
- Write clear reasons for changes. Credit, access, and role changes should include notes so the audit trail is useful.
Admin access is powerful. Only change users, credits, model settings, or active specs when you understand the effect.
Credits Overview
Credits are the units Jymni Ethics Advisor uses to run AI-backed work. Each evaluation, rewrite, follow-up question, spec test, or other LLM process can use credits.
Credits protect the service. They help control model cost, prevent accidental overuse, and make usage easier to track.
Purchasing is the normal refill path. Stripe-hosted checkout is available when live keys and plan prices are configured. Trial/support requests are manually reviewed exceptions.
| Topic | Plain meaning | Admin action |
|---|---|---|
| What credits are | A balance that lets a user run paid AI work inside Advisor, Studio, and admin testing tools. | Check balances in Analytics, Requests, or the Users tab. |
| Why credits exist | AI model calls have real cost. Credits make that cost visible and help keep usage fair. | Use the Rate Card to see or change how many credits each process costs. |
| How users get more now | Users buy a configured credit pack through Stripe-hosted checkout. Completed purchases are fulfilled by a signed webhook and shown in account purchase history. | Verify checkout configuration and investigate the order or credit ledger if fulfillment looks incorrect. |
| Trial/support exceptions | Eligible users submit a structured reason, amount, intended use, and optional organization, timeline, and note. The system caps requests, allows one pending request, requires low balance for most reasons, and applies a cooldown. | Use Requests to assess the stated reason and context, then approve, adjust, or decline with a clear admin note. |
How to handle a credit request
- Open Requests. Start with Pending requests so active needs appear first.
- Review the user. Check their current balance, request reason, intended use, organization, timeline, optional note, and recent request history.
- Approve, adjust, or decline. You can approve a different amount than the user requested when that is the better choice.
- Add a note. Explain the decision so the audit trail is useful later.
- Confirm the balance. After approval, check the user record if you need to confirm the new credit total.
Analytics
The Analytics tab gives a fast view of platform activity. Use it to see volume, feature mix, user growth, credit activity, and LLM usage.
Switch between 1 day, 7 days, 14 days, 30 days, and 90 days.
Shows which features users run most often.
Requests
The Requests tab is where admins review exceptional trial/support credit requests. Filter by pending, approved, declined, or all requests. Each card shows the reason, intended use, organization, requested timeline, optional user note, amount, and decision history that are available.
- Open Requests. Start with Pending so active requests appear first.
- Review the request context. Check the reason, intended use, organization, timeline, optional note, requested amount, current credits, paid-order and purchased-credit totals, last purchase, prior request/grant totals, and automatic review flags before approving.
- Adjust the credit amount if needed. You can approve a different number than the user requested.
- Add an admin note. Use notes to explain why the request was approved or declined. Approved grants record a specific source for beta, support, nonprofit/education, or sales-trial use.
Review flags are decision support. New-account, repeated-request, recent-purchase, disabled-account, and above-threshold flags highlight facts for review; they do not approve or decline a request automatically. A recent purchase should normally limit a manual grant to a genuine evaluation error, nonprofit/education exception, or sales-assisted trial.
Users
The Users tab lets admins search accounts, create users, change credits, manage access, and review usage. Super admins can also change roles.
| Action | Use it when | Admin note |
|---|---|---|
| Create user | A person needs a new account. | Use a strong temporary password and the correct role. |
| Apply credit change | A user needs more credits or a credit correction. | Use a positive number to add credits and a negative number to remove credits. |
| Disable account | An account should not be used right now. | Add a clear reason. Re-enable only when access is approved. |
| Force logout | A user lost a device, changed roles, or may have an unsafe session. | This clears active sessions, but does not delete the account. |
| Set role | A super admin needs to grant or remove admin access. | Use the lowest role that still lets the person do their job. |
| Delete user | An account and saved data must be permanently removed. | This requires an email challenge and cannot be undone from Admin. |
Audit Trail
The Audit tab records important admin actions. Use it to answer who changed credits, access, roles, requests, policy rules, or evaluation specs.
- Check actor: Who made the change.
- Check target: Which user, request, rule, or spec was affected.
- Check metadata: Extra details such as credits, notes, and before or after values.
- Use dates: Match audit records to support tickets or review meetings.
LLM
The LLM tab controls the active Google model and API key. It also shows model usage, estimated spend, tokens, and latency.
Changing the model: Select the model, then save. Review quality and cost after the change.
Rotating the key: Only paste a new API key when you are replacing credentials. Keep keys out of chat, tickets, and screenshots.
- Estimated spend: Approximate LLM cost for the selected time range.
- Total tokens: Input and output token volume.
- Evaluations: LLM-backed actions with stored usage.
- Average latency: How long requests take on average.
- Model mix: Which models were used and what they cost.
Rate Card
The Rate Card tab controls how many credits each process costs. Use it when you need to change credit pricing for evaluations, rewrites, tests, or follow-up actions.
- Review base credits. The base value is the default cost.
- Enter an override only when needed. Leave the field blank to use the base value.
- Save pricing. New runs use the updated effective credit cost.
Evaluation Specs
Evaluation Specs are the rule books Studio uses when it reviews a case. They tell Studio what to look for, how to score it, what risks matter, and how to explain the result.
The active spec is live. Studio uses it for real evaluations. Active cards show a Live now label. To switch, choose another spec and select Make live.
Spec tests use credits. Run enough tests to be confident, but do not test the same case over and over without a reason.
Page layout and scrolling
On desktop, the Evaluation Specs page has two columns. The left column is the version stack. The right column has the editor and test tools. Each column scrolls on its own, so the mouse wheel works where your pointer is.
- Version stack: Use the left column to select drafts, archived specs, and the live spec.
- Editor and test tools: Use the right column to edit fields, review the read-only output contract, and run spec tests.
- Text boxes: Criteria fields grow with normal content. A field only shows its own scrollbar when that one field gets very long.
What an Evaluation Spec controls
| Area | What admins set | Why it matters |
|---|---|---|
| Purpose and scope | The kind of work the spec is meant to judge. | Keeps Studio focused on the right type of personal decision. |
| People and context | Who is affected, what relationships and power differences matter, and where the choice occurs. | Helps Studio avoid one-size-fits-all advice. |
| Scoring dimensions | The score areas, such as ethical risk, clarity, evidence, or likely impact. | Controls what Studio rewards, warns about, or asks users to improve. |
| Classification rules | The labels Studio can apply, such as safe, needs review, or high risk. | Makes results easier to sort and act on. |
| Evidence rules | How Studio should treat facts, assumptions, missing context, and evidence. | Prevents strong conclusions when the user has not supplied enough support. |
| Reasoning and tone | How direct, careful, and practical the answer should be. | Shapes the quality of the feedback people see in Studio. |
| Calibration examples | Sample cases and the kind of result they should produce. | Gives the spec examples to follow, which helps keep results steady. |
| Platform output contract | The required result format Studio expects. | Treat this as read-only unless engineering tells you to change it. Studio needs this format to display results. |
Version stack
| Status | Meaning | Can edit? | Best use |
|---|---|---|---|
| Draft | A work-in-progress spec that can be tested before use. | Yes. | Use drafts for edits, tests, and review before making a spec live. |
| Active | The spec Studio uses for live evaluations. | No. Clone it before changing behavior. | Use active as the main version. |
| Archived | A saved old spec that is not used for live evaluations. | Usually no, but it can be cloned. | Use archived specs to keep history or restore an older approach. |
Common actions
| Action | Use it when | What happens |
|---|---|---|
| View | You need to inspect a spec without changing it. | The spec opens so you can review its identity, criteria, examples, and test area. |
| New draft | You need a fresh spec that does not start from the active one. | Admin creates a new editable draft. |
| Clone | You want to change an existing spec safely. | Admin makes a draft copy. Change the draft, not the original. |
| Save draft | You have changed identity, criteria, examples, or test notes. | The draft is stored, but Studio users do not see the change yet. |
| Make live | The draft has passed review and spec tests. | The draft becomes the active spec. New Studio evaluations use it. |
| Archive | A spec should be kept for history but not used. | The spec is saved, but it is no longer live. |
| Delete draft | A draft is wrong, old, or no longer needed. | The draft is removed if the delete option is available. |
Recommended process
- Review the active spec. Read the current purpose, scoring rules, examples, and result format before you change anything.
- Clone the active spec. Start from the live rule book when you want a careful update. Use New draft only for a larger reset.
- Update the identity fields. Use a clear name, version label, and scope so other admins know why the draft exists.
- Edit one part at a time. Small changes are easier to test. Avoid changing scoring, tone, examples, and classification rules all at once.
- Add or update calibration examples. Use examples that show the behavior you want Studio to repeat.
- Save the draft. Saving does not make it live. It only stores the draft so you can test it.
- Run Spec test. Use real or realistic cases. Compare the draft result with the active spec result.
- Review the differences. Look at labels, scores, risk flags, missing facts, tone, and action steps.
- Revise and retest. If the draft is too strict, too loose, confusing, or uneven, edit it and run another test.
- Make live only after review. Making a spec live changes Studio behavior for new evaluations.
Sample specs
Admin includes a sample draft named Trust and Power personal ethics spec. It focuses on whether the people involved are trustworthy, transparent about their interests, respectful of consent, and using power responsibly.
Use the Trust and Power sample when a choice depends on advice, private information, unequal authority, dependence, or a conflict of interest. Test it before using Make live.
Spec test
Spec test is the dry run for an Evaluation Spec. It lets you test a selected spec against a case before that spec becomes live. Use it before making any draft live.
Build a useful test case
- Use a real or realistic case. Include the choice, people affected, relationships, setting, stakes, and goal.
- Add facts when they exist. Include relevant history, promises, consent, alternatives, evidence, and likely outcomes.
- Call out the risk. Note vulnerability, health or money issues, urgency, unequal power, personal data, safety, or social pressure.
- Include missing facts on purpose. A good spec should notice when consent, relationship detail, likely consequences, or evidence is missing.
- Keep the case readable. A clear test case gives a clearer comparison.
Run and compare
- Select the draft or archived spec you want to test. The selected spec result shows how that spec would answer.
- Paste the test case. Use enough detail for Studio to understand the case, not just a vague one-line description.
- Choose Compare with active spec when available. This shows the current live result beside the selected spec result.
- Run the test. The run uses credits and may take a moment because it calls the evaluation model.
- Study the differences. A better draft should be clearer, more useful, and more consistent with your rules.
| Compare this | What to look for | Good sign |
|---|---|---|
| Classification | Did the label move from safe to needs review, or the other way around? | The label matches the real risk in the case. |
| Scores | Did ethical risk, evidence, clarity, or impact scores move for a clear reason? | The score change is easy to explain from the facts. |
| Risk flags | Did Studio catch vulnerability, missing facts, pressure, unequal power, or high-stakes topics? | Important risks are named without adding risks that are not present. |
| Missing facts | Did Studio ask for facts or context when the case lacked them? | The result says what is missing and why it matters. |
| Advice quality | Are the action steps clear, practical, and tied to the case? | A Studio user could act on the advice right away. |
| Tone | Is the result firm without being alarmist? | The answer is direct, plain, and balanced. |
Use a small test set
| Test case | What to include | Pass signal |
|---|---|---|
| Clear safe case | An ordinary choice with clear facts, consent, and no sensitive pressure. | The draft does not over-warn or block useful feedback. |
| High-risk case | A health, money, safety, abuse, or vulnerable-person situation. | The draft catches the risk and asks for facts, professional help, or human review. |
| Missing-facts case | A consequential choice with little information about consent, likely harm, or alternatives. | The draft names the missing facts and avoids guessing. |
| Vulnerable-person case | A choice affecting a child, older adult, patient, dependent person, job seeker, or someone under stress. | The draft treats the affected person with extra care. |
| Borderline case | A choice that could become sound if consent, timing, communication, or a repair plan improves. | The draft gives useful changes instead of a simple yes or no. |
Decision rules
- Make live when the draft is better than the active spec across several test cases and the output still fits Studio.
- Revise when one test improves but another gets worse, or when the result is too strict, too soft, or unclear.
- Do not make live if the draft changes the platform output contract, breaks display fields, or gives results that admins cannot explain.
- Archive older drafts that are no longer being tested so the list stays clean.
Policy Memory
Policy Memory stores compact personal-ethics guardrails. A rule can apply when trigger terms match a case, or it can always be included.
- Add a clear title. Use a name that explains the rule, such as Medical decisions need qualified help.
- Choose a type. Types include prohibited action, required disclosure, vulnerable person or group, high-stakes topic, and reflection rule.
- Add trigger terms. Use terms that should cause the rule to appear during an evaluation.
- Write short guidance. Tell the evaluator exactly what to watch for or require.
- Save the rule. Keep Active checked if the rule should be used now.
Good policy rules are short. Use direct guidance that fits into an evaluation prompt. Do not paste long legal policies into one rule.
Safety Rules
Who should be an admin?
Only people who need to manage users, credits, policy, specs, or model settings. Use normal user access for everyone else.
When should I force logout?
Force logout after role changes, lost devices, suspicious access, or when a user leaves the organization.
When should I rotate the LLM API key?
Rotate it when credentials may be exposed, when your key policy requires it, or when moving to a new billing project.
Should I edit the active evaluation spec?
No. Clone the active spec, edit the draft, test it, then use Make live when it is ready.