Splunk Stream on-premise deployment architecture (2024)

To deploy Splunk Stream you install three Stream components on your Splunk software.

Product nameInstallation package nameInstalled file name
Splunk App for Streamsplunk_app_streamsplunk_app_stream/
Splunk Add-on for Stream ForwardersSplunk_TA_streamSplunk_TA_stream/
Splunk Add-on for Stream Wire DataSplunk_TA_stream_wire_dataSplunk_TA_stream_wire_data/

Splunk Stream also provides Independent Stream Forwarders (ISF). ISF installation is packaged as a binary file <streamfwd> in the Splunk App for Stream package.

For more about Splunk Stream components, see Splunk Stream installation package overview in this manual.

Splunk Stream supports most deployment architectures:

  • Managed Splunk Cloud deployments
  • Distributed deployment configurations, including deployment servers and indexer clusters
  • Single instance deployments, where a single instance of Splunk Enterprise is both the indexer and the search head
  • Independent Stream Forwarders (ISF) on compatible Linux machines

Single instance deployment

When you install Splunk Stream on a single Splunk Enterprise instance, that instance serves as both search head and indexer and provides both search and storage capability. A single instance deployment can support one or two users running concurrent searches, which is ideal for a small test environment. For single instance installation instructions, see Install Splunk Stream on a single instance in this manual.

Distributed Splunk Stream deployment

A Splunk Stream distributed deployment can capture network event data from multiple network devices, including NICs, switches, and routers. A distributed deployment can be used in medium and large enterprise network infrastructures. For distributed installation instructions, see Install Splunk Stream in a distributed environment in this manual.

A distributed deployment for Splunk Stream includes the following deployment locations and Splunk Stream components:

Splunk deployment locationSplunk Stream component
search headsThe Splunk App for Stream (splunk_app_stream) and Splunk Add-on for Stream Wire data (Splunk_TA_stream_wire_data) must be installed on search heads.

You can optionally install Splunk Add-on for Stream Forwarders (splunk_TA_stream) if you want to collect data from the search head or want to use the PCAP upload.

indexersSplunk Add-on for Stream Wire Data (Splunk_TA_stream_wire_data) must be installed on all indexers for searching and parsing. Splunk Add-on for Stream Wire Data contains both search and index time knowledge objects.
universal forwardersThe Splunk Add-on for Stream Forwarders (Splunk_TA_stream) must be installed on universal forwarders where you want to capture network data. For dedicated wire capture in Linux environments without a universal forwarder, use the Independent Stream Forwarder (ISF). For more information, see Network collection architectures in this manual
heavy forwarderIf you use a heavy forwarder in your Splunk Stream configuration, the Splunk Add-on for Stream Forwarders (Splunk_TA_stream) must be installed on universal or heavy forwarders where you want to capture network data. You must also install the Add-on for Stream Wire Data (Splunk_TA_stream_wire_data) on your heavy forwarder wherever that index performs pipeline processing.
deployment serverUse the Splunk deployment server to distribute The Splunk Add-on for Stream Forwarders package (Splunk_TA_stream) to universal forwarders across a distributed deployment. When you upgrade to a new version of Splunk Stream, the deployment server detects whether a new version of The Splunk Add-on for Stream Forwarders exists. If a new version is found, all universal forwarders subscribed as deployment clients pull and install the new version of the add-on. For more information, see
  • Deployment server provisioning in Upgrading Splunk Enterprise Instances.
  • Components of a Splunk Enterprise deployment in the Splunk Enterprise Capacity Planning Manual.
Independent Stream Forwarder (ISF)The ISF is a standalone Stream forwarder. The ISF sends captured network data to Splunk using the HTTP event collector, and does not require a Splunk universal forwarder to collect wire data. It is helpful in networks and deployments where a universal forwarder cannot be installed. See Install an Independent Stream Forwarder

How a distributed Splunk Stream deployment works

In a typical distributed deployment, the Splunk Add-on for Stream Forwarders is installed on universal forwarders as Splunk_TA_Stream. Once installed, the forwarder captures network event data on local NICs, such as each node of a subnet environment, or from a network SPAN or TAP. For more information about data collection, see Network collection architectures in this manual.

The network data that a Stream forwarder captures depends on the specific protocols and fields that you select when you configure a stream using the Configure Streams UI that the Splunk App for Stream provides when you install it. The Stream forwarder sends that captured event data to indexers using the Splunk Add-on for Stream Wire Data (Splunk_TA_stream_wire_data).

Splunk_TA_stream/local/inputs.conf stores the location of the Splunk App for Stream (splunk_app_stream) installation, . The Stream forwarder uses this location to ping the Splunk App For Stream over HTTP port 8000. If the Stream forwarder detects a change in the Splunk Stream configuration, the Stream forwarder sends an API request to the endpoint to get the latest configuration data.

For more information about configuring the Splunk Add-on for Stream Forwarders, see Configure Stream Forwarders in this manual.

Splunk Stream on-premise deployment architecture (2024)

FAQs

Splunk Stream on-premise deployment architecture? ›

To deploy Splunk Stream you install three Stream components on your Splunk software. Splunk Stream also provides Independent Stream Forwarders (ISF). ISF installation is packaged as a binary file <streamfwd> in the Splunk App for Stream package.

Can Splunk be deployed on premise? ›

You can deploy Splunk Enterprise Security on-premises and on Splunk Cloud Platform.

How does Splunk Stream work? ›

Stream collects network data and forwards it to Splunk Enterprise or Splunk Cloud. Stream does not analyze logs. If you can use a UF to send logs to Splunk then you don't need Stream.

What are the best practices for Splunk architecture? ›

Best Practices for Splunk Architecture Optimization

Understand your data ingestion rate and ensure your indexers can handle the load. Your Splunk license must be sized appropriately to handle your data volume. Second, you must take into consideration your data center, resiliency and redundancy needs.

Can Splunk Cloud act as a deployment server? ›

Any full Splunk Enterprise instance - even one indexing data locally - can act as a deployment server. A deployment server cannot be a client of itself. A deployment client is a Splunk instance remotely configured by a deployment server.

How to do on premise deployment? ›

Step 1 (Option 1): Setting Up a VM with VMware ESXi 6.7 Web Interface
  1. 1.1 Downloading the VM Image. ...
  2. 1.2 Creating the VM. ...
  3. 1.3 Selecting the VM Type. ...
  4. 1.4 Deploying the OVF/OVA File. ...
  5. 1.5 Selecting the Storage. ...
  6. 1.6 Specifying the Deployment Options. ...
  7. 1.7 Completing the VM Creation. ...
  8. 1.8 Accessing the VM's Settings.

Which are types of Splunk platform deployments? ›

These are some of the main types of deployments, based on size:
  • Departmental. A single instance that combines indexing and search management functions.
  • Small enterprise. One search head with two or three indexers.
  • Medium enterprise. A small search head cluster, with several indexers.
  • Large enterprise.
Sep 4, 2015

What is the difference between streaming and non streaming Splunk? ›

Non-streaming commands run on the search head. By contrast, a streaming command operates on each event as the event is returned by the search. Any command in a search that occurs after a non-streaming command must also be processed on the search head.

How does Splunk deployment server work? ›

deployment server

A Splunk Enterprise instance that acts as a centralized configuration manager, grouping together and collectively managing any number of Splunk Enterprise instances. Instances that are remotely configured by deployment servers are called deployment clients.

How does stream work? ›

The term streaming refers to the continual transmission of audio and video files from a server to a client. In video streams, content is sent in a compressed form over the internet and is displayed by the viewer in real time. The media is sent in a continuous stream of data and is played as it arrives.

What are 3 main components in a Splunk architecture? ›

Splunk Components. The primary components in the Splunk architecture are the forwarder, the indexer, and the search head.

What are the 4 types of searches in Splunk by performance? ›

How search types affect Splunk Enterprise performance
Search typeRef. indexer throughputPerformance impact
DenseUp to 50,000 matching events per second.CPU-bound
SparseUp to 5,000 matching events per second.CPU-bound
Super-sparseUp to 2 seconds per index bucket.I/O bound
RareFrom 10 to 50 index buckets per second.I/O bound

What are the pillars of Splunk? ›

Each design principle reinforces one or more pillars of the Splunk Validated Architectures (SVAs): Availability, Performance, Scalability, Security, and Manageability.

Can Splunk be deployed on Prem? ›

To deploy Splunk Stream you install three Stream components on your Splunk software. Splunk Stream also provides Independent Stream Forwarders (ISF).

What are the 2 Splunk deployment models in the cloud? ›

How deployment architecture affects a Splunk app in Splunk Cloud Platform or Splunk Enterprise
Deployment typeDescription
Single-instanceIncludes all three tiers of functionality.
DistributedSeparates the tiers across different components.
1 more row

Which of the Splunk components is connected with deployment server? ›

Deployment server

You can use it to distribute updates to most types of Splunk components: forwarders, non-clustered indexers, and non-clustered search heads.

Is Splunk on-prem or cloud? ›

Splunk Enterprise is the flagship offering from Splunk, which is designed to be deployed on-premises within an organization's own data center or private cloud.

Can Threat Grid be deployed on-premise? ›

On premises

The appliances provide highly secure malware analysis and advanced sandboxing. Information is kept on site. The appliance may be configured to share sample data with integrating devices.

Can SaaS be deployed on-premise? ›

On premises and software as a service (SaaS) are two ways that your organization can deploy and use software required for business operations. In the on-premises model, your organization acquires and installs the software on on-premises data centers.

Can you deploy Salesforce on-premise? ›

When data from Salesforce is archived on-premise, what essentially happens is that all the legacy data is sent to an indexed database in the company's on-premise storage. This usually gives enterprises more control over the data while making it easily viewable, searchable, & accessible.

References

Top Articles
Newly constructed houses you can buy in Dothan
Usher and Janet Jackson headline 30th Essence Festival of Culture
Dana Point: Your Ultimate Guide to Coastal Adventures
Miramar Water Utility
Busted Newspaper Birmingham Al
Suriname vacancies - working in Paramaribo - Teleperformance
Beach Umbrella Home Depot
123Movies The Idol
Sigma Aldrich Calculator
Angelaalvarez Leak
manhattan cars & trucks - by owner - craigslist
R Umineko
Craigslist Shallotte
92801 Sales Tax
Smart fan mode msi, what's it for and does it need to be activated?
Oriellys Bad Axe
Ge Tracker Awakener Orb
Huniepop Jessie Questions And Answers
Who should be in the Country Music Hall of Fame (but isn't yet)? Our picks
Reforge Update – Which Reforges Are The Best? – Hypixel Skyblock - Sirknightj
Overton Funeral Home Waterloo Iowa
Tina's Nails Stanwood
Kfc $30 Fill Up Substitute Sides
Sm64Ex Coop Mods
PoE Reave Build 3.25 - Path of Exile: Settlers of Kalguur
Pain Out Maxx Kratom
One Piece Chapter 1077 Tcb
Altametrics Login Little Caesars
Pennys Department Store Near Me
By Association Only Watsonville
No Cable Schedule
Showcameips
Nickelodeon Home Media
Jeep Graphics Ideas
Calculating R-Value: How To Calculate R-Value? (Formula + Units)
Stanley Steemer Medford Oregon
Crimson Draughts.
Kino am Raschplatz - Vorschau
The Ultimate Guide To Kaitlyn Krems Of
Ben Rickert Net Worth
Joy Ride 2023 Showtimes Near Amc Ward Parkway
Bolly4u Movies Site - Download Your Favorite Bollywood Movies Here
Denny's Ace Hardware Duluth Mn
Topic: Prisoners in the United States
Skip Da Games.com
Nc Maxpreps
Rabbi Raps
Lagoon Pontoons Reviews
Circle K Wikipedia
Hollyday Med Spa Prairie Village
Mileage To Walmart
Csuf Mail
Latest Posts
Article information

Author: Rev. Leonie Wyman

Last Updated:

Views: 5997

Rating: 4.9 / 5 (59 voted)

Reviews: 82% of readers found this page helpful

Author information

Name: Rev. Leonie Wyman

Birthday: 1993-07-01

Address: Suite 763 6272 Lang Bypass, New Xochitlport, VT 72704-3308

Phone: +22014484519944

Job: Banking Officer

Hobby: Sailing, Gaming, Basketball, Calligraphy, Mycology, Astronomy, Juggling

Introduction: My name is Rev. Leonie Wyman, I am a colorful, tasty, splendid, fair, witty, gorgeous, splendid person who loves writing and wants to share my knowledge and understanding with you.