Is ChatGPT coming for your job?
Is ChatGPT coming for your job?

I need your clothes, your boots and your employee ID. OpenAI’s Large Language Model (LLM) chatbot exploded onto the scene last November. In less than a week ChatGPT had over 4 million users and the Internet was awash with examples of prompts used and output from the chatbot. Some of the responses were so good that it didn’t take long for a wave of people claiming ChatGPT would make programmers, writers, support, and a whole host of other roles obsolete. A few months in and the doomsayers are still predicting widespread replacement of humans.

So how accurate are these claims of this particular AI offering taking our jobs?

...

Amazon Redshift now supports Elastic resize
Development Amazon Redshift now supports Elastic resize

One of the major pain points for me with Amazon Redshift has always been the coupling between storage and compute. Competitors like Snowflake and Google’s BigQuery offer independent compute and storage, which means easier (and quicker) scaling in times of increased load. Redshift’s main drawback in the scalability sense has been that it can take up to 24 hours to resize your cluster (during which it’s in read-only mode), meaning there’s a lot of pressure to get your cluster configuration spot on before you go into production. Redshift’s provision of elasticity is just not up to par with most of Amazon’s other services. While Redshift Spectrum helps with this, it’s not a solution to the issue of scalability for an existing cluster.

In the lead up to re:Invent, Amazon last night dropped a load of really neat announcements (server-side encryption for DynamoDB as standard, SSE support for SNS), among which was the reveal of Elastic resize for Redshift. As an aside, if this is the stuff they’re announcing now, there should be some really nice announcements at re:Invent.

read more
Redshift Spectrum finally supports Enhanced VPC routing
Development Redshift Spectrum finally supports Enhanced VPC routing

What seems like an age ago, I spotted a setting on one of our Redshift clusters that suggested Enhanced VPC routing support for Redshift Spectrum might be on the way. After waiting a while, and waiting some more, and then waiting some more, it seems that Amazon have finally released this into the wild, and Redshift Spectrum now works with clusters that have Enhanced VPC routing available!

As of Build 1.0.4349 or Build 1.0.4515, this functionality will be available in Redshift. It hasn’t made it into the official announcements yet, but it has popped up on the Redshift forums here: https://forums.aws.amazon.com/ann.jspa?annID=6197

read more
AWS releasing in-browser Query Editor for Redshift
Development AWS releasing in-browser Query Editor for Redshift

One of the things that I really like about Google BigQuery is the ability to write queries right there in the web browser without having to install a hefty IDE. Sure, there are times when having the full power of something like JetBrains DataGrip comes in handy (source control integration, customisation, formatting), but sometimes you just want to dive in and write a quick query without any messing around. Amazon did this for Athena, which was really handy, but strangely never did so for Redshift…until now!

read more
My Top 4 Games of 2017
Gaming My Top 4 Games of 2017

I did it last year, so it’s time to do it again. Actually, it was time to do it again about six months ago but life got in the way. Here are my top games from 2017. Caveat: This list is only from games I’ve played myself in my limited available time. There are plenty of other great games that I just haven’t got round to yet.

read more
6 Tips for developing with AWS Lambda Functions
Development 6 Tips for developing with AWS Lambda Functions

AWS Lambda functions are getting a lot of press right now, with “serverless” being the topic de jour. We’ve been using it extensively and it’s incredibly flexible and useful, although not suitable for every situation. It really does remove a lot of obstacles for the average developer. In saying that, there are a few tips that I’d like to share based on our experiences with Lambda. Many of these may be no-brainers, but it’s always worth sharing these things as you never know when they’ll be useful.

read more
SQS vs SNS for Lambda Dead Letter Queues
Development SQS vs SNS for Lambda Dead Letter Queues

Serverless computing and event-driven functions are what it’s all about at the moment. But what happens when the event trigger fires, and your process then encounters an error? How do you recover from this given the event has since passed and may never happen again? This is a common question in AWS when working with their serverless, event-driven Lambda Functions.

Fortunately, AWS lets you define Dead Letter Queues for this very scenario. This option allows you to designate either an SQS queue or SNS topic as a DLQ, meaning that when your Lambda function fails it will push the incoming event message (and some additional context) onto the specified resource. If it’s SNS you can send out alerts or trigger other services (maybe even a retry of the same function - although watch out for infinite loops), or any combination of the above, given its fanout nature. If it’s SQS you can persist the message and process it with another service.

So let’s look at both options in a little more detail.

read more
Is AWS about to enable Redshift Spectrum with Enhanced VPC Routing?
Development Is AWS about to enable Redshift Spectrum with Enhanced VPC Routing?

AWS is knocking it out of the park at the moment with loads of new services and features coming out every week. Indeed, it can be hard to keep up with the degree of change. But, while working on one of our Redshift clusters today we spotted a potential scoop that would remove a key blocker for one extremely useful service, Redshift Spectrum.

Up until now it’s only been possible to use Spectrum if you don’t have Enhanced VPC Routing enabled on your Redshift cluster. There are so many benefits to using Enhanced VPC Routing (reduced data transfer cost, control, security) that it’s hard to see why anyone wouldn’t be using it, especially if you move data between Redshift and S3 a lot.

But we spotted a new parameter being applied to one of our clusters when we made some maintenance changes to a parameter group. There’s now a parameter named spectrum_enable_enhanced_vpc_routing showing, which hints that Amazon may be about to remove this crucial limitation.

read more

About

picnicerror.net is a personal blog where I post various ideas, thoughts and discoveries through both my day to day work in marketing technology and general hobbies and interests.

Know More

Tag

Social