HTTP/S Bulk Endpoint

Our HTTP/S bulk endpoint is great to send larger batches of line-separated events with faster transmission speed. You can send a maximum of 5MB per batch and up to 1MB per event. You can send plaintext or any type of automatically parsed log including JSON.

Basic

1. Setup our HTTP/S Bulk Endpoint

You can configure your application to POST data directly to Loggly at this URL. This is not a web page so don’t open it in your browser. You can use the curl test below.

https://logs-01.loggly.com/bulk/TOKEN/tag/bulk/ 

Replace:

• TOKEN: your customer token from the source setup page

2. Test Sending Data

One way to test the endpoint is to curl an example with "Hello" and "World" on two separate lines, which will create two separate events. Copy this to a terminal window, insert your customer token and file name, then send the data. This example assumes you use the bash shell.

curl -H "content-type:text/plain" -d $'Hello\nWorld' https://logs-01.loggly.com/bulk/TOKEN/tag/bulk/ 

3. Verify

After sending the event, you should see the response ok which indicates we received it.

{"response" : "ok"} 

Verify you can find the logs in search with the bulk tag within the last 20 minutes. It may take a few minutes to index the event. If it doesn’t work, see the troubleshooting section below.

tag:bulk 

Advanced Options

• HTTP/S Endpoint – for sending single events or multiline events
• File Upload – use the bulk endpoint to upload files smaller than 5MB
• Tracking Pixel – if you can only make GET requests use our tracking pixel
• Automated Parsing – we automatically parse many types of logs including JSON and timestamps
• Tags – our examples use the http tag but you can include your own tags
• Encrypt Data – Just switch the URL to https to encrypt the data. The SSL handshake may increase latency. It will also use port 443 instead of port 80.
• Encoding – By default Loggly assumes the encoding of ‘application/x-www-form-urlencoded’ and will convert data to JSON automatically. You can set encoding in your header to ‘text/plain’ to leave your data alone and store it as regular text.
• Search or post your own question in the community forum.

Troubleshooting

Troubleshooting HTTP offers tips if you don’t see data in the verification steps.

The scripts are not supported under any SolarWinds support program or service. The scripts are provided AS IS without warranty of any kind. SolarWinds further disclaims all warranties including, without limitation, any implied warranties of merchantability or of fitness for a particular purpose. The risk arising out of the use or performance of the scripts and documentation stays with you. In no event shall SolarWinds or anyone else involved in the creation, production, or delivery of the scripts be liable for any damages whatsoever (including, without limitation, damages for loss of business profits, business interruption, loss of business information, or other pecuniary loss) arising out of the use of or inability to use the scripts or documentation.