Skip to content

RateLimiter

Coordinates rate limits through shared persistent storage.

The RateLimiter service consumes tokens for string keys using fixed-window counters or token-bucket state. It can protect external APIs, enforce quotas, or throttle workers across fibers and processes that share the same store. This module includes helpers that fail when a limit is exceeded, return the delay needed before continuing, or wrap an effect so it waits automatically. It also defines the store service and in-memory or Redis-backed store layers.

25 exports Added in v4.0.0 Source

Accessors

Accesses a function that applies rate limiting to an effect.

Signature

declare const makeWithRateLimiter: Effect.Effect<
(options: {
readonly algorithm?: "fixed-window" | "token-bucket";
readonly key: string;
readonly limit: number;
readonly onExceeded?: "delay" | "fail";
readonly tokens?: number;
readonly window: Duration.Input;
}) => <A, E, R>(effect: Effect.Effect<A, E, R>) => Effect.Effect<A, E | RateLimiterError, R>,
never,
RateLimiter
>;

sleep

Added in v4.0.0 Source

Sleeps when the rate limit is exceeded.

Signature

declare function sleep(
self: RateLimiter,
): (options: {
readonly algorithm?: "fixed-window" | "token-bucket";
readonly key: string;
readonly limit: number;
readonly tokens?: number;
readonly window: Input;
}) => Effect<ConsumeResult, RateLimiterError>;
declare function sleep(
self: RateLimiter,
options: {
readonly algorithm?: "fixed-window" | "token-bucket";
readonly key: string;
readonly limit: number;
readonly tokens?: number;
readonly window: Input;
},
): Effect<ConsumeResult, RateLimiterError>;

Constructors

make

Added in v4.0.0 Source

Creates a RateLimiter from the current RateLimiterStore.

Details

The limiter supports fixed-window and token-bucket algorithms and either fails or returns a delay when a limit is exceeded.

Signature

declare const make: Effect.Effect<RateLimiter, never, RateLimiterStore>;

Creates a Redis-backed RateLimiterStore using Lua scripts and the configured key prefix.

Signature

declare const makeStoreRedis: (
...args: [
options?: {
readonly prefix?: string;
},
]
) => Effect<
{
readonly adaptiveConsume: (
options: AdaptiveConsumeOptions,
) => Effect<AdaptiveConsumeResult, RateLimiterError>;
readonly adaptiveFeedback: (options: AdaptiveFeedbackOptions) => Effect<void, RateLimiterError>;
readonly fixedWindow: (options: {
readonly key: string;
readonly limit: number | undefined;
readonly refillRate: Duration;
readonly tokens: number;
}) => Effect<readonly [number, number], RateLimiterError>;
readonly tokenBucket: (options: {
readonly allowOverflow: boolean;
readonly key: string;
readonly limit: number;
readonly refillRate: Duration;
readonly tokens: number;
}) => Effect<number, RateLimiterError>;
},
never,
Redis
>;

Errors

Error raised by rate limiter operations, wrapping a concrete failure reason.

Signature

declare class RateLimiterError extends {
readonly _tag: "RateLimiterError";
readonly reason: RateLimitExceeded | RateLimitStoreError;
} & YieldableError<this> {
constructor(props: {
readonly reason: RateLimiterErrorReason;
});
readonly "~@effect/experimental/RateLimiter/RateLimiterError": "~@effect/experimental/RateLimiter/RateLimiterError";
message: string;
}

Schema for all reasons that can be carried by RateLimiterError.

Signature

declare const RateLimiterErrorReason: Union<[typeof RateLimitExceeded, typeof RateLimitStoreError]>;

Union of reasons carried by RateLimiterError.

Signature

type RateLimiterErrorReason = RateLimitExceeded | RateLimitStoreError;

Error reason for a rate-limit check that exceeded the configured limit.

Details

Includes the affected key, limit, remaining token count, and retry delay.

Signature

declare class RateLimitExceeded extends {
readonly _tag: "RateLimitExceeded";
readonly key: string;
readonly limit: number;
readonly remaining: number;
readonly retryAfter: Duration;
} & YieldableError<this> {
constructor(...args: [props: {
readonly _tag?: "RateLimitExceeded";
readonly key: string;
readonly limit: number;
readonly remaining: number;
readonly retryAfter: Duration;
}, options?: MakeOptions]);
message: string;
}

Error reason for failures in the backing RateLimiterStore.

Signature

declare class RateLimitStoreError extends {
readonly _tag: "RateLimitStoreError";
readonly cause?: unknown;
readonly message: string;
} & YieldableError<this> {
constructor(...args: [props: {
readonly _tag?: "RateLimitStoreError";
readonly cause?: unknown;
readonly message: string;
}, options?: MakeOptions]);
}

Layers

layer

Added in v4.0.0 Source

Provides RateLimiter using the current RateLimiterStore.

Signature

declare const layer: Layer.Layer<RateLimiter, never, RateLimiterStore>;

Provides a process-local in-memory RateLimiterStore.

Signature

declare const layerStoreMemory: Layer.Layer<RateLimiterStore>;

Provides a Redis-backed RateLimiterStore using makeStoreRedis.

Signature

declare const layerStoreRedis: (options?: {
readonly prefix?: string;
}) => Layer.Layer<RateLimiterStore, never, Redis.Redis>;

Provides a Redis-backed RateLimiterStore from wrapped configuration options.

Signature

declare function layerStoreRedisConfig(
options:
| {
readonly prefix?: Config<string | undefined>;
}
| Config<{
readonly prefix?: string;
}>,
): Layer<RateLimiterStore, ConfigError, Redis>;

Models

AdaptiveConsumeResult interface

Added in v4.0.0 Source

Metadata returned after consuming tokens from the adaptive rate limiter store.

Signature

interface AdaptiveConsumeResult {
readonly delay: Duration;
readonly epoch: number;
readonly phase: AdaptivePhase;
}

AdaptivePhase type

Added in v4.0.0 Source

Phase of adaptive rate limiting driven by server feedback.

Signature

type AdaptivePhase = "inactive" | "cooldown" | "learning" | "learned";

ConsumeResult interface

Added in v4.0.0 Source

Metadata returned after consuming tokens from a rate limiter.

Signature

interface ConsumeResult {
readonly delay: Duration;
readonly limit: number;
readonly remaining: number;
readonly resetAfter: Duration;
}

RateLimiter interface

Added in v4.0.0 Source

Service for consuming rate-limit tokens for a key using fixed-window or token-bucket algorithms.

Signature

interface RateLimiter {
readonly "~effect/persistence/RateLimiter": "~effect/persistence/RateLimiter";
readonly adaptiveConsume: (
options: AdaptiveConsumeOptions,
) => Effect<AdaptiveConsumeResult, RateLimiterError>;
readonly adaptiveFeedback: (options: AdaptiveFeedbackOptions) => Effect<void, RateLimiterError>;
readonly consume: (options: {
readonly algorithm?: "fixed-window" | "token-bucket";
readonly key: string;
readonly limit: number;
readonly onExceeded?: "delay" | "fail";
readonly tokens?: number;
readonly window: Input;
}) => Effect<ConsumeResult, RateLimiterError>;
}

Options

AdaptiveConsumeOptions interface

Added in v4.0.0 Source

Options for consuming tokens from the adaptive rate limiter store.

Signature

interface AdaptiveConsumeOptions {
readonly fallbackLimit: number;
readonly fallbackWindow: Duration;
readonly key: string;
readonly tokens: number;
}

AdaptiveFeedbackOptions interface

Added in v4.0.0 Source

Options for reporting response feedback to the adaptive rate limiter store.

Signature

interface AdaptiveFeedbackOptions {
readonly epoch: number;
readonly key: string;
readonly retryAfter: Duration | undefined;
readonly status: number;
readonly tokens: number;
}

Services

RateLimiter

Added in v4.0.0 Source

Service tag for persistent token-consumption services.

When to use

Use to access or provide rate-limit checks backed by fixed-window counters or token-bucket state.

Signature

declare const RateLimiter: Service<RateLimiter, RateLimiter>;

Defines the low-level backing store for rate-limit state.

When to use

Use to provide the shared counter storage and adaptive feedback state used by persistent rate-limit checks.

Signature

declare class RateLimiterStore extends Shape<
"effect/persistence/RateLimiter/RateLimiterStore",
{
readonly adaptiveConsume: (
options: AdaptiveConsumeOptions,
) => Effect<AdaptiveConsumeResult, RateLimiterError>;
readonly adaptiveFeedback: (options: AdaptiveFeedbackOptions) => Effect<void, RateLimiterError>;
readonly fixedWindow: (options: {
readonly key: string;
readonly limit: number | undefined;
readonly refillRate: Duration;
readonly tokens: number;
}) => Effect<readonly [number, number], RateLimiterError>;
readonly tokenBucket: (options: {
readonly allowOverflow: boolean;
readonly key: string;
readonly limit: number;
readonly refillRate: Duration;
readonly tokens: number;
}) => Effect<number, RateLimiterError>;
},
this
> {
constructor(_: never);
}

Type IDs

ErrorTypeId

Added in v4.0.0 Source

Runtime type identifier for RateLimiterError.

Signature

declare const ErrorTypeId: ErrorTypeId;

ErrorTypeId type

Added in v4.0.0 Source

Type-level identifier used to brand RateLimiterError values.

Signature

type ErrorTypeId = "~@effect/experimental/RateLimiter/RateLimiterError";

TypeId

Added in v4.0.0 Source

Runtime type identifier for RateLimiter values.

Signature

declare const TypeId: TypeId;

TypeId type

Added in v4.0.0 Source

Type-level identifier used to brand RateLimiter values.

Signature

type TypeId = "~effect/persistence/RateLimiter";