Machine cost and the machine budget
Requests to a model on your own machine are recorded at $0: the machine is paid for by the hour whether it serves one request or a thousand. Prism therefore counts what the machines cost separately and shows it next to API spend. It does not divide machine cost among requests.
How it is counted
Section titled “How it is counted”Every machine has two prices per hour: while on and while off (what a stopped cloud instance is still billed for, such as its disks). For a Nebius machine Prism reads both from the provider’s price list. A machine with no price shows no price with a link to the monitor.
To enter your own price, open the machine in the compute monitor and press enter a price or Change. Enter the amount the way your provider bills it and choose how it is paid:
- By the time it runs: an amount per minute, hour, day, month or year while the machine is on, and optionally an amount while it is off. A month is 730 hours and a year 8760 hours, as clouds count them.
- Rent: the same amount whether the machine is on or off, such as a dedicated server billed monthly. A month’s rent is spread over the days of that month, so a whole month costs exactly the rent.
- Paid in advance: a sum paid for a term (its start date and length in months or years), spread evenly over its days. After the term the machine has no price, and the monitor asks for a new one.
The dialog shows what the amount comes to per hour, day and month.
- Running is the time the machine was powered on × the price while on.
- Idle of it is the part of the running cost while its GPUs were idle.
- While off is the time a cloud machine was powered off × the price while off. With rent or a prepaid term, all the time the machine was not on counts as off, at the same price. Otherwise a machine without a cloud host is never counted as off.
- Total is running + while off.
Prism adds every minute to the machine’s row for that day (UTC), at the prices in effect during that minute. A new price counts from today by default; the days before keep what they cost. Days are kept for the current month and the 13 months before it.
Correcting a wrong price. In the price dialog choose Correct the past too, from and a date. The days already recorded from that date are priced again with the new price, and reports and the machine budget show the corrected cost. Remove my price returns the machine to the provider’s price (or to no price) and leaves the recorded days as they are.
When Prism starts this record for the first time, it fills in the days the monitor still has (up to 30) at the prices known then; those days are marked as estimated. Time recorded before a machine had any price is priced with the first price it gets, and marked the same way.
Where you see it
Section titled “Where you see it”Usage history → Overview shows, for the selected period, the API spend, the machine cost and their total, and a Machines table: per machine the hours powered on, idle and off, the running cost, its idle part, the cost while off and the total. The totals say when some machine has no price. The period counts whole UTC days that begin inside it.
The API report GET /prism/cost carries the same numbers in machines and
the sum of both in total_with_machines_usd, when the report is not narrowed
to a user, application, provider, model or result. With format=text it
adds machines_cost_usd, total_with_machines_usd and one machine= line
per machine.
The machine budget
Section titled “The machine budget”The machine budget is one amount in USD per calendar month (UTC) for all machines of the organization. Set it under the Machines table with Change budget; leave it empty for no budget.
When the month’s machine cost reaches 80 % and 100 % of the budget, Prism sends one notification each, per month, through the notification bell, email (the Budgets and quotas category) and the webhook. Nothing else happens: no machine is powered off and no request is refused because of it.
Budgets of people, teams and applications on the Organization page count API spend only; machine cost is not part of them.