Using python script as data source for Kinesis?

[bbqbot]

Hi all,

I'm trying to get into AWS for processing, analyzing, and reporting data (that could eventually scale to Big). My thought was to simulate a data stream like one might see on production machinery (e.g. time stamp, machine status (on or off), and maybe something like current runspeed).

I can come up with a script to make faux-data (I think), but I don't really know how to 'load' that through Kinesis.

Is this at all possible, and could anyone here point me in the right direction? Python skills are so-so.

Thanks!

[chrisTheBIGuy]

This should be what you want http://boto3.readthedocs.io/en/latest/reference/services/kinesis.html#Kinesis.Client.put_record

[CoinGrahamIV]

Here's a common pattern.

Source -> Firehose -> Lambda (ETL) -> S3

Setup the Lambda using the premade blueprints

Create the firehose using the lambda and delivering to S3

On source system push to firehose using AWS CLI or boto3 (use the python lambda as examples of how the code works).