Skip to main content

Solana Shred Streams

This section provides details about Bitquery's Solana Shred Streams via Kafka. The top-level Kafka section explains how we use Kafka Streams to deliver data.

You can find the schema here.

Remember that Solana blocks are produced with a target block time of 400ms, in practice resulting in high throughput of approximately 4,000 transactions per second while achieving a theoretical maximum of 65,000 transactions per second (TPS).

Structure of On-Chain Data​

The Solana Protobuf Streams provide three main message types for different use cases:

  • BlockMessage: Basic blocks, transactions, and rewards
  • TokenBlockMessage: Focused on token transfers and currency metadata
  • DexParsedBlockMessage: Specialized for DEX (Decentralized Exchange) activity

Block-Level Data​

Each block in the stream includes a BlockHeader with fields such as:

  • Slot: The slot number for this block
  • Hash: The unique identifier of the block
  • ParentSlot: The previous slot in the chain
  • Height: The block height
  • Timestamp: The Unix timestamp when this block was produced
  • ParentHash: The hash of the parent block

Transaction-Level Data​

Transactions across all stream types share common elements:

  • Signature: The transaction's unique signature
  • Status: The execution status (Success/Error)
  • Header: Transaction metadata including fees and signers
  • Index: Position within the block

Transactions contain various types of instructions, which are the core of Solana's execution model:

  • ProgramAccountIndex: The program being called
  • Data: Encoded instruction data
  • AccountIndexes: Accounts referenced by this instruction
  • BalanceUpdates: SOL balance changes from this instruction

Token Data​

The TokenBlockMessage stream provides detailed information about token transfers and balances:

  • Transfer: Records token movements with:

    • Amount: Number of tokens transferred
    • Sender: Source account
    • Receiver: Destination account
    • Authority: Account authorizing the transfer
    • Currency: Detailed token information

  • Currency: Rich metadata for each token, including:

    • Name, Symbol, Decimals
    • MintAddress: Token's mint account
    • MetadataAddress: Metadata program account
    • TokenCreators: Original creators of the token
    • NFT properties like SellerFeeBasisPoints and TokenStandard

The solana.tokens.proto topic uses this message type to share details of:

Account Addresses​

  • These are listed under the "Accounts" section of the transaction header.

Balance Updates​

  • These are listed under "BalanceUpdates", with each update linked to an account using the AccountIndex.

  • Each balance update has:

    • PreBalance: The balance of the account before the transaction.
    • PostBalance: The balance of the account after the transaction.
    • Currency Details: Information about the currency type (e.g., Solana (SOL), Wrapped Solana (WSOL)).

Balance Updates After Each Instruction​

  • These updates are shown under the "BalanceUpdates" section within each instruction of the transaction.
  • These updates reflect the immediate effect of an instruction on the balance of the involved wallets.
  • For example, if an instruction transfers a certain amount from one wallet to another, the balance update directly after this instruction will reflect the new balances for both wallets.

Balance Updates After the Entire Transaction​

  • These updates are shown under the "BalanceUpdates" section at the transaction level.
  • They show the final state of the balances after all instructions in that transaction have been executed.
  • This is essentially the final balance state of all wallets involved in that transaction.

DEX (Decentralized Exchange) Data​

The DexParsedBlockMessage stream is specialized for decentralized exchange activity:

  • DexInfo: Details about the exchange program

    • ProgramAddress: Address of the DEX program
    • ProtocolName: Name of the DEX
    • ProtocolFamily: Family of DEX protocols

  • DexTradeEvent: Records of trades executed on DEXs

    • Buy/Sell: Trade sides with amounts and accounts
    • Market: The trading pair information
    • Fee: Transaction fee
    • Royalty: Creator royalties paid

  • PoolLiquidityChangeEvent: Records changes to liquidity pools

    • BaseCurrency/QuoteCurrency: The pool's assets
    • ChangeAmount: Amount added or removed

Using This Stream in Python, JavaScript, and Go​

Python, JavaScript, and Go code samples can be used with these streams by changing the topic to one of:

The below is the topic -> message mapping :

  • solana.transactions.proto -> ParsedIdlBlockMessage
  • solana.tokens.proto -> TokenBlockMessage
  • solana.dextrades.proto -> DexParsedBlockMessage

The Python package bitquery-pb2-kafka-package includes all schema and is up to date so you don't have to manually install schema files.

Video Tutorial to Get Low Latency Solana Data via Kafka​

Video Tutorial to Get Real-time PumpSwap Trades via Bitquery Kafka Streams​