클라우드/GCP(28)
-
14. Cloud Composer: Copying BigQuery Tables Across Different Locations
'다른 리전에서 bigquery 테이블을 복사하기' 인데 composer에 대해 공부하고 싶어서 수행했다. Task 1. Create a Cloud Composer environment 수행 과제 :Click the dropdown for Show Advanced Configuration and select Airflow database zone as us-east4-b. Task 2. Create Cloud Storage bucketscomposer 생성시 자동으로 storage 생성됨 Create a bucket in US Create a bucket in EU Task 3. Create the BigQuery destination dataset Task 4. Airflow and core con..
2024.11.22 -
13. Cloud Logging and Monitoring for BigQuery
PART 1: Analyze Cloud Logging logsTask 1: Open BigQueryTask 2: Create a datasetSELECT current_date Task 4: Set up log export from Cloud Logging Look for the entry that contains the word "jobcompleted". Create Sink Task 5: Run example queries bq query --location=us --use_legacy_sql=false --use_cache=false \'SELECT fullName, AVG(CL.numberOfYears) avgyears FROM `qwiklabs-resources.qlbqsamples.per..
2024.11.21 -
그림으로 배우는 구글 클라우드 101
이 책을 살까말까 망설이던 와중에.. https://www.thecloudgirl.dev/data-analytics Data Analytics — The Cloud Girl www.thecloudgirl.dev 작가의 홈페이지를 발견했다. 책의 내용이 나와있다. https://youtube.com/playlist?list=PLTWE_lmu2InBzuPmOcgAYP7U80a87cpJd&feature=shared GCP SketchnotesIf you are looking to become a Google Cloud Engineer , then you are at the right place. GCP Sketchnotes is series where I share Google Cloud concepts in..
2024.11.20 -
12. BigQuery Soccer Data Analytical Insight
Task 1. Open BigQuery테스트 랩이라 이미 데이터셋 및 테이블이 작성되어있음 쿼리문에 쿼리 작성SELECT Events.playerId, (Players.firstName || ' ' || Players.lastName) AS playerName, SUM(IF(Tags2Name.Label = 'assist', 1, 0)) AS numAssistsFROM `soccer.events` Events, Events.tags TagsLEFT JOIN `soccer.tags2name` Tags2Name ON Tags.id = Tags2Name.TagLEFT JOIN `soccer.players` Players ON Events.playerId = Players.wyIdGROUP BY playe..
2024.11.20 -
11. Setting Up Network and HTTP Load Balancers [ACE]
Task 1. Set the default region and zone for all resourcesgcloud config set compute/zone us-central1-agcloud config set compute/region us-central1 Task 2. Create multiple web server instancesgcloud compute instance-templates create nginx-template \ --metadata-from-file startup-script=startup.sh gcloud compute target-pools create nginx-pool gcloud compute instance-groups managed create n..
2024.11.19 -
10. Analyzing Billing Data with BigQuery
Task 1. Locate your dataset and table in BigQuery Task 2. Examine the billing dataTask 3. Analyze data using SQL queries Query 1: Analyze your data based on costs SELECT * FROM `billing_dataset.enterprise_billing` WHERE Cost > 0 billing_dataset.enterprise_billing 테이블에서 비용(Cost)이 0보다 큰 모든 레코드를 조회 SELECT project.name as Project_Name, service.description as Service, location.country as Country,..
2024.11.18