UNICORN Binance Local Depth Cache¶

A Python SDK by LUCIT for accessing and managing multiple local Binance order books with Python in a simple, fast, flexible, robust and fully functional way.

The organization of the DepthCache takes place in the same asyncio loop as the reception of the websocket data. The full stack of the UBS modules (REST, WebSocket and DepthCache) can be downloaded and installed by PyPi and Anaconda as a Python C extension for maximum performance.

Part of ‘UNICORN Binance Suite’.

Get help with the integration of the UNICORN Binance Suite modules!

Get a UNICORN Binance Suite License¶

To run modules of the UNICORN Binance Suite you need a valid license!

Using a DepthCache¶

Create a local DepthCache for Binance with just 3 lines of code¶

from unicorn_binance_local_depth_cache import BinanceLocalDepthCacheManager, DepthCacheOutOfSync

ubldc = BinanceLocalDepthCacheManager(exchange="binance.com", depth_cache_update_interval=100)
ubldc.create_depthcache("BTCUSDT")

Get the asks and bids ¶

To obtain the complete order book¶

asks = ubldc.get_asks("BTCUSDT")
bids = ubldc.get_bids("BTCUSDT")

Get the first X elements¶

asks = ubldc.get_asks("BTCUSDT", limit_count=10)
bids = ubldc.get_bids("BTCUSDT", limit_count=10)

Retain the elements until volume X has been exceeded¶

asks = ubldc.get_asks("BTCUSDT", threshold_volume=300000)
bids = ubldc.get_bids("BTCUSDT", threshold_volume=300000)

Catch an exception, if the DepthCache is out of sync while accessing its data¶

try:
    asks = ubldc.get_asks(market="BTCUSDT", limit_count=5, threshold_volume=300000)
    bids = ubldc.get_bids(market="BTCUSDT", limit_count=5, threshold_volume=300000)
except DepthCacheOutOfSync:
    asks = "Out of sync!"
    bids = "Out of sync!"

Stop and delete a DepthCache:¶

ubldc.stop_depthcache("BTCUSDT")

Stop `ubldc` after usage to avoid memory leaks¶

When you instantiate UBLDC with with, ubldc.stop_manager() is automatically executed upon exiting the with-block.

with BinanceWebSocketApiManager() as ubldc:
    ubldc.create_depthcache("BTCUSDT")

Without with, you must explicitly execute ubldc.stop_manager() yourself.

ubldc.stop_manager()

Discover more possibilities.

Connect to a UNICORN DepthCache Cluster for Binance¶

The UNICORN DepthCache Cluster for Binance is a separate Kubernetes application for managing multiple DepthCaches including load balancing and fail over.

Synchronous¶

from unicorn_binance_local_depth_cache import BinanceLocalDepthCacheManager, DepthCacheClusterNotReachableError

async def main():
    ubldc.cluster.create_depthcache(exchange="binance.com", markets=['BTCUSDT', 'ETHUSDT'], desired_quantity=3)
    while ubldc.is_stop_request() is False:
        print(ubldc.cluster.get_asks(exchange="binance.com", market='BTCUSDT', limit_count=2))
        
try:
    with BinanceLocalDepthCacheManager(exchange=exchange, ubdcc_address="192.10.80.4") as ubldc:
        try:
            asyncio.run(main())
        except KeyboardInterrupt:
            print("\r\nGracefully stopping ...")
except DepthCacheClusterNotReachableError as error_msg:
    print(f"ERROR: {error_msg}")

Asynchronous¶

from unicorn_binance_local_depth_cache import BinanceLocalDepthCacheManager, DepthCacheClusterNotReachableError

async def main():
    await ubldc.cluster.create_depthcache_async(exchange="binance.com", 
                                                markets=['BTCUSDT', 'ETHUSDT'], 
                                                desired_quantity=3)
    while ubldc.is_stop_request() is False:
        print(await ubldc.cluster.get_asks_async(exchange="binance.com", market='BTCUSDT', limit_count=2))
        
try:
    with BinanceLocalDepthCacheManager(exchange=exchange, ubdcc_address="192.10.80.4") as ubldc:
        try:
            asyncio.run(main())
        except KeyboardInterrupt:
            print("\r\nGracefully stopping ...")
except DepthCacheClusterNotReachableError as error_msg:
    print(f"ERROR: {error_msg}")

Try UNICORN DephtCache Cluster for Binance examples!

Discover more cluster possibilities …

Description¶

The Python package UNICORN Binance Local Depth Cache provides local order books for the Binance Exchanges Binance (+Testnet), Binance Futures (+Testnet) and Binance US.

The algorithm of the DepthCache management was designed according to these instructions:

Since, according to Binance’s predefined algorithm, all levels > 1000 would be orphaned and remain forever between valid levels , UBLDC removes them as soon as they exceed the thousandth position.

With create_depthcache()` the DepthCache is started and initialized, i.e. for each DepthCache that is to be created, a separate asyncio coroutine is inserted into the event loop of the stream. As soon as at least one depth update is received via websocket, a REST snapshot is downloaded and the depth updates are applied to it so that it is synchronized in real time. As soon as once this is done, the status of the cache get set to “synchronous”.

Data in the DepthCache can be accessed with ‘get_asks()’ and ‘get_bids()’. If the state of the DepthCache is not synchronous during access, the exception ‘DepthCacheOutOfSync’ is thrown.

The DepthCache will immediately start an automatic re-initialization if a gap in the UpdateID`s is detected (missing update event) or if the websocket connection is interrupted. As soon as this happens the state of the DepthCache is set to “out of sync” and when accessing the cache the exception ‘DepthCacheOutOfSync’ is thrown.

Why a local DepthCache?¶

A local DepthCache is the fastest way to access the current order book depth at any time while transferring as little data as necessary. A REST snapshot takes a lot of time and the amount of data that is transferred is relatively large. Continuous full transmission of the order book via websocket is faster, but the amount of data is huge. A local depth_cache is initialized once with a REST snapshot and then handles Diff. Depth updates applied by the websocket connection. By transferring a small amount of data (only the changes), a local depth_cache is kept in sync in real time and also allows extremely fast (local) access to the data without exceeding the Binance request weight limits.

What are the benefits of the UNICORN Binance Local Depth Cache?¶

Always know if the cache is in sync! If the DepthCache is out of sync, the exception ‘DepthCacheOutOfSync’ is thrown or ask with is_depth_cache_synchronized().
If a depth cache is out of sync it gets refreshed automatically within a few seconds.
100% Websocket auto-reconnect!
Supported Exchanges

Exchange	Exchange string
Binance	`binance.com`
Binance Testnet	`binance.com-testnet`
Binance USD-M Futures	`binance.com-futures`
Binance USD-M Futures Testnet	`binance.com-futures-testnet`
Binance US	`binance.us`

Create multiple depth caches within a single object instance.
Each DepthCache is managed in an asyncio coroutine.
Start or stop multiple caches with just one command create_depthcache() or stop_depthcache().
Control websocket out of sync detection with websocket_ping_interval, websocket_ping_timeout and websocket_close_timeout
Powered by UNICORN Binance REST API and UNICORN Binance WebSocket API.
Available as a package via pip and conda as precompiled C extension with stub files for improved Intellisense functions and source code for easier debugging of the source code. To the installation.

If you like the project, please it on GitHub!

Live Demo¶

This live demo script runs DepthCaches from binance.com-futures and runs on a CCX13 virtual machine of HETZNER CLOUD.

Open live monitor!

(Refresh update once a minute!)

Installation and Upgrade¶

The module requires Python 3.8 and runs smoothly up to and including Python 3.12.

For the PyPy interpreter we offer packages only from Python version 3.9 and higher.

Anaconda packages are available from Python version 3.8 and higher, but only in the latest version!

The current dependencies are listed here.

If you run into errors during the installation take a look here.

Packages are created automatically with GitHub Actions¶

When a new release is to be created, we start two GitHubActions:

Both start virtual Windows/Linux/Mac servers provided by GitHub in the cloud with preconfigured environments and create the respective compilations and stub files, pack them into wheels and conda packages and then publish them on GitHub, PYPI and Anaconda. This is a transparent method that makes it possible to trace the source code behind a compilation.

A Cython binary, PyPy or source code based CPython wheel of the latest version with `pip` from PyPI ¶

Our Cython and PyPy Wheels are available on PyPI, these wheels offer significant advantages for Python developers:

Performance Boost with Cython Wheels: Cython is a programming language that supplements Python with static typing and C-level performance. By compiling Python code into C, Cython Wheels can significantly enhance the execution speed of Python code, especially in computationally intensive tasks. This means faster runtimes and more efficient processing for users of our package.
PyPy Wheels for Enhanced Efficiency: PyPy is an alternative Python interpreter known for its speed and efficiency. It uses Just-In-Time (JIT) compilation, which can dramatically improve the performance of Python code. Our PyPy Wheels are tailored for compatibility with PyPy, allowing users to leverage this speed advantage seamlessly.

Both Cython and PyPy Wheels on PyPI make the installation process simpler and more straightforward. They ensure that you get the optimized version of our package with minimal setup, allowing you to focus on development rather than configuration.

Installation¶

pip install unicorn-binance-local-depth-cache

Update¶

pip install unicorn-binance-local-depth-cache --upgrade

A Conda Package of the latest version with `conda` from Anaconda ¶

The unicorn-binance-local-depth-cache package is also available as a Cython version for the linux-64, osx-64 and win-64 architectures with Conda through the lucit channel.

For optimal compatibility and performance, it is recommended to source the necessary dependencies from the conda-forge channel.

Installation¶

conda config --add channels conda-forge
conda config --add channels lucit
conda install -c lucit unicorn-binance-local-depth-cache

Update¶

conda update -c lucit unicorn-binance-local-depth-cache

From source of the latest release with PIP from GitHub ¶

Linux, macOS, …¶

Run in bash:

pip install https://github.com/LUCIT-Systems-and-Development/unicorn-binance-local-depth-cache/archive/$(curl -s https://api.github.com/repos/LUCIT-Systems-and-Development/unicorn-binance-local-depth-cache/releases/latest | grep -oP '"tag_name": "\K(.*)(?=")').tar.gz --upgrade

Windows¶

Use the below command with the version (such as 2.8.0) you determined here:

pip install https://github.com/LUCIT-Systems-and-Development/unicorn-binance-local-depth-cache/archive/2.8.0.tar.gz --upgrade

From the latest source (dev-stage) with PIP from GitHub ¶

This is not a release version and can not be considered to be stable!

pip install https://github.com/LUCIT-Systems-and-Development/unicorn-binance-local-depth-cache/tarball/master --upgrade

Change Log¶

https://lucit-systems-and-development.github.io/unicorn-binance-local-depth-cache/changelog.html

Documentation¶

Examples¶

Look here!

Howto¶

How to Obtain and Use a Unicorn Binance Suite License Key and Run the UBS Module According to Best Practice

Project Homepage¶

https://www.lucit.tech/unicorn-binance-local-depth-cache.html

Wiki¶

https://github.com/LUCIT-Systems-and-Development/unicorn-binance-local-depth-cache/wiki

Receive Notifications¶

To receive notifications on available updates you can the repository on GitHub, write your own script with using is_update_available().

Follow us on LinkedIn, X or Facebook!

To receive news (like inspection windows/maintenance) about the Binance API`s subscribe to their telegram groups:

How to report Bugs or suggest Improvements?¶

List of planned features - click thumbs-up if you need one of them or suggest a new feature!

Before you report a bug, try the latest release. If the issue still exists, provide the error trace, OS and Python version and explain how to reproduce the error. A demo script is appreciated.

If you dont find an issue related to your topic, please open a new issue!

Report a security bug!

Contributing¶

UNICORN Binance Local Depth Cache is an open source project which welcomes contributions which can be anything from simple documentation fixes and reporting dead links to new features. To contribute follow this guide.

Contributors¶

We love open source!

Disclaimer¶

This project is for informational purposes only. You should not construe this information or any other material as legal, tax, investment, financial or other advice. Nothing contained herein constitutes a solicitation, recommendation, endorsement or offer by us or any third party provider to buy or sell any securities or other financial instruments in this or any other jurisdiction in which such solicitation or offer would be unlawful under the securities laws of such jurisdiction.

If you intend to use real money, use it at your own risk!¶

Under no circumstances will we be responsible or liable for any claims, damages, losses, expenses, costs or liabilities of any kind, including but not limited to direct or indirect damages for loss of profits.

Commercial Support¶

Do you need a developer, operator or consultant? Contact us for a non-binding initial consultation!

UNICORN Binance Local Depth Cache¶

Get a UNICORN Binance Suite License¶

Using a DepthCache¶

Create a local DepthCache for Binance with just 3 lines of code¶

Get the asks and bids¶

To obtain the complete order book¶

Get the first X elements¶

Retain the elements until volume X has been exceeded¶

Catch an exception, if the DepthCache is out of sync while accessing its data¶

Stop and delete a DepthCache:¶

Stop ubldc after usage to avoid memory leaks¶

Connect to a UNICORN DepthCache Cluster for Binance¶

Synchronous¶

Asynchronous¶

Description¶

Why a local DepthCache?¶

What are the benefits of the UNICORN Binance Local Depth Cache?¶

Live Demo¶

Installation and Upgrade¶

Packages are created automatically with GitHub Actions¶

A Cython binary, PyPy or source code based CPython wheel of the latest version with pip from PyPI¶

Installation¶

Update¶

A Conda Package of the latest version with conda from Anaconda¶

Installation¶

Update¶

From source of the latest release with PIP from GitHub¶

Linux, macOS, …¶

Windows¶

From the latest source (dev-stage) with PIP from GitHub¶

Change Log¶

Documentation¶

Examples¶

Howto¶

Project Homepage¶

Wiki¶

Social¶

Receive Notifications¶

How to report Bugs or suggest Improvements?¶

Contributing¶

Contributors¶

Disclaimer¶

If you intend to use real money, use it at your own risk!¶

Commercial Support¶

Get the asks and bids ¶

Stop `ubldc` after usage to avoid memory leaks¶

A Cython binary, PyPy or source code based CPython wheel of the latest version with `pip` from PyPI ¶

A Conda Package of the latest version with `conda` from Anaconda ¶

From source of the latest release with PIP from GitHub ¶

From the latest source (dev-stage) with PIP from GitHub ¶