This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "_comment": "Demo wide event for Honeycomb — illustrating exponential value of context. 250 dimensions across request, user, org, infra, db, cache, trace, feature flags, performance, business, security, and experiment contexts. Any two fields can be combined. With 250 fields, that's 250*249/2 = 31,125 possible 2-way combinations — and combinatorial explosion beyond that.", | |
| "timestamp": "2025-03-07T14:23:41.872Z", | |
| "duration_ms": 342.7, | |
| "trace.trace_id": "7f3a92b1c4e05d68af291b3c7e84f012", | |
| "trace.span_id": "a1b2c3d4e5f60718", | |
| "trace.parent_span_id": "9e8d7c6b5a4f3021", | |
| "trace.span_name": "POST /api/v2/checkout/complete", |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| PRODUCTION root@kafka-6c3f65f0:~# kafkacat -L -b localhost:9092 | |
| Metadata for all topics (from broker -1: localhost:9092/bootstrap): | |
| 4 brokers: | |
| broker 1003 at ip-10-0-246-113.ec2.internal:9092 | |
| broker 1004 at ip-10-0-190-45.ec2.internal:9092 | |
| broker 1009 at ip-10-0-213-10.ec2.internal:9092 | |
| broker 1001 at ip-10-0-148-52.ec2.internal:9092 | |
| 4 topics: | |
| topic "hound-dogfood.retriever-mutation" with 1 partitions: | |
| partition 0, leader 1001, replicas: 1001, isrs: 1001 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## declare all the env-specific variables that are defined in *.tfvars | |
| variable "env" { } | |
| variable "name" { } | |
| variable "size" { } | |
| variable "cidr" { } | |
| variable "instance_type" { } | |
| variable "kafka_instance_type" { } | |
| variable "retriever_instance_type" { } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ### these variables should be the same across all environments | |
| # your aws secret key and access key should be in your env variables | |
| provider "aws" { | |
| region = "us-east-1" | |
| } | |
| variable "tf_s3_bucket" { default = "hound-terraform-state" } | |
| variable "master_state_file" { default = "base.tfstate" } | |
| variable "prod_state_file" { default = "production.tfstate" } # TODO: make init.sh use these variables | |
| variable "staging_state_file" { default = "staging.tfstate" } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| # Usage: ./init.sh once to initialize remote storage for this environment. | |
| # Subsequent tf actions in this environment don't require re-initialization, | |
| # unless you have completely cleared your .terraform cache. | |
| # | |
| # terraform plan -var-file=./production.tfvars | |
| # terraform apply -var-file=./production.tfvars | |
| tf_env="production" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash -xe | |
| # requires jq 1.5 (or at least > 1.3) and kafkacat | |
| PATH=$PATH:/usr/lib/kafka/bin | |
| topic="hound-staging.retriever-mutation" | |
| which kafkacat || echo 'no kafkacat found, bye!' && exit 1 | |
| which jq || echo 'no jq found, bye!' && exit 1 | |
| # make sure jq is v 1.5 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # snippet from terraform/env-dev/peering.tf | |
| # import staging state, add routes from dev to staging | |
| resource "terraform_remote_state" "staging_state" { | |
| backend = "s3" | |
| config { | |
| bucket = "${var.tf_s3_bucket}" | |
| region = "${var.region}" | |
| key = "${var.staging_state_file}" | |
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # file name: terraform/env-staging/peering.tf | |
| # No peering / direct connectivity between staging and prod, for safety. | |
| resource "terraform_remote_state" "dev_state" { | |
| backend = "s3" | |
| config { | |
| bucket = "${var.tf_s3_bucket}" | |
| region = "${var.region}" | |
| key = "${var.dev_state_file}" | |
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # file name terraform/modules/aws_vpc/vpc.tf | |
| # first create the VPC. | |
| # Prefix resources with var.name so we can have many environments trivially | |
| resource "aws_vpc" "mod" { | |
| cidr_block = "${var.cidr}" | |
| enable_dns_hostnames = "${var.enable_dns_hostnames}" | |
| enable_dns_support = "${var.enable_dns_support}" | |
| tags { | |
| Name = "${var.env}_vpc" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # file name: infra/terraform/modules/aws_vpc/bastion_sg.tf | |
| resource "aws_security_group" "bastion_ssh_sg" { | |
| name = "bastion_ssh" | |
| description = "Allow ssh to bastion hosts for each vpc from anywhere" | |
| ingress { | |
| from_port = 22 | |
| to_port = 22 | |
| protocol = "tcp" | |
| cidr_blocks = ["0.0.0.0/0"] |
NewerOlder