Devfest Cloud 2023 - 편집 역사

2023년 12월 10일 (일) 01:59에 Ryanyang님의 편집

2023-12-10T01:59:13Z

@@ 216번째 줄: / 216번째 줄: @@
 https://bit.ly/matthias-beam-demo
-== Reference ==
+== References ==
 * https://beam.apache.org/
@@ 222번째 줄: / 222번째 줄: @@
 * https://www.oreilly.com/radar/the-world-beyond-batch-streaming-101/
 * https://www.oreilly.com/radar/the-world-beyond-batch-streaming-102/

2023년 12월 9일 (토) 06:43에 Ryanyang님의 편집

2023-12-09T06:43:29Z

← 이전 판		2023년 12월 9일 (토) 15:43 판
160번째 줄:		160번째 줄:
	*https://developers.googleblog.com/2023/12/how-its-made-gemini-multimodal-prompting.html		*https://developers.googleblog.com/2023/12/how-its-made-gemini-multimodal-prompting.html
	*https://blog.google/technology/ai/google-gemini-ai/		*https://blog.google/technology/ai/google-gemini-ai/

			= Open Source Large-scale Streaming Analytics Using Apache Beam =
			Speaker : Matthias Baetens (Singapore GDE, Senior Cloud Architect @ DoiT)

			Keywords : Apache Beam, Google Cloud Dataflow

			== Technical intro ==


			Scaling up has limitation; it can't make it bigger forever. That's why scaling out comes up. Distribution technology has been used.


			Stream processing makes it possible to gather data more frequently.


			'''Event time''' : the time something happened

			'''Processing time''' : the time the event is processed (always some time later than its event time)


			Stream processing : <u>Windowing</u>


			To handle the stream data, we need to set a boundary where the data can be handled at the same time.


			Stream processing : <u>Triggering</u>


			Trade-offs:

			# Completeness
			# Latency
			# Cost $$$

			=== Apahe Beam ===

			* Java, Python, Go supports

			=== Google Cloud Dataflow ===

			* Fully managed data processing solution
			* Autoscaling of resources
			* Optimisation (graph, dynamic work rebalancing,...)
			* Monitoring and logging

			== Use cases ==

			* Dynamic pricing Lyft rides using Apache Beam
			* Feature Generation at LinkedIn
			* Quantifying counterparty credit risk
			* Large scale streaming analytics using Apache Beam & Cloud Cloud Dataflow

			== Demo ==
			https://bit.ly/matthias-beam-demo

			== Reference ==

			* https://beam.apache.org/
			* https://cloud.google.com/customers/hsbc-risk-advisory-tool
			* https://www.oreilly.com/radar/the-world-beyond-batch-streaming-101/
			* https://www.oreilly.com/radar/the-world-beyond-batch-streaming-102/

2023년 12월 9일 (토) 06:01에 Ryanyang님의 편집

2023-12-09T06:01:59Z

← 이전 판		2023년 12월 9일 (토) 15:01 판
158번째 줄:		158번째 줄:
	* https://cloud.google.com/blog/topics/google-cloud-next/welcome-to-google-cloud-next-23		* https://cloud.google.com/blog/topics/google-cloud-next/welcome-to-google-cloud-next-23
	* https://blog.google.com/technology/ai/google-gemini-ai/		* https://blog.google.com/technology/ai/google-gemini-ai/
			*https://developers.googleblog.com/2023/12/how-its-made-gemini-multimodal-prompting.html
			*https://blog.google/technology/ai/google-gemini-ai/

2023년 12월 9일 (토) 05:48에 Ryanyang님의 편집

2023-12-09T05:48:07Z

@@ 57번째 줄: / 57번째 줄: @@
 By calling the APIs provided by Google you can easily utilize embedding technologies.
 '''ScaNN''' The vector search service for Google Searchv
@@ 73번째 줄: / 73번째 줄: @@
 * https://developers.google.com/machine-learning/crash-course/embeddings/video-lecture
 * https://atlas.nomic.ai/map/vertex-stack-overflow

2023년 12월 9일 (토) 05:06에 Ryanyang님의 편집

2023-12-09T05:06:32Z

← 이전 판		2023년 12월 9일 (토) 14:06 판
30번째 줄:		30번째 줄:
	* 행사 홈페이지 https://festa.io/events/4385		* 행사 홈페이지 https://festa.io/events/4385
	* Google Developer Groups https://developers.google.com/community/gdg		* Google Developer Groups https://developers.google.com/community/gdg

			= Build LLM-powered apps with embeddings, vector search and RAG =
			스피커 : Kaz Sato (Staff Developer Advocate (ML) @ Google Cloud (Tokyo)


			<u>Vertex AI Embeddings API + Vector Search - Grounding LLMs made easy</u>


			Integrating LLMs with existing IT systems without hallucination is crucial in business. LLMs are just probability language model; that's why there could be hallucination in their answers.


			RAG는 LLM 과 Vertex AI 를 활용해서 할루시네이션을 없앰


			'''What is Embeddings?'''


			Embeddings are translating data into vectors. AI builds an <u>embedding space</u> as <u>a map of meaning</u>.


			An '''embedding''' is a relatively low-dimensional space into which you can translate high-dimensional vectors. Embeddings make it easier to do machine learning on large inputs like sparse vectors representing words. Ideally, an embedding captures some of the semantics of the input by placing semantically similar inputs close together in the embedding space. An embedding can be learned and reused across models.


			'''Vectex AI Embeddings API for Text'''


			By calling the APIs provided by Google you can easily utilize embedding technologies.


			'''ScaNN''' The vector search service for Google Searchv

			== RAG ==
			Retrieval Augmented Generation is used to beat hallucination. by using '''vector search''' to support LLM.

			== VLM ==
			LLMs with vision change businesses.

			== Reference ==

			* https://ai-demos.dev/
			* https://github.com/GoogleCloudPlatform/vertex-ai-samples/tree/main
			* https://developers.google.com/machine-learning/crash-course/embeddings/video-lecture
			* https://atlas.nomic.ai/map/vertex-stack-overflow

2023년 12월 9일 (토) 04:25에 Ryanyang님의 편집

2023-12-09T04:25:28Z

← 이전 판		2023년 12월 9일 (토) 13:25 판
1번째 줄:		1번째 줄:
	= Building Your Tech Career with Developer Communities =		= <키노트> Building Your Tech Career with Developer Communities =
	스피커 : 개발자 생태계(DEVREL 데브렐) 팀 by Kristine Song (구글 8년차, 3번째 팀이고 이전에는 HR에 있었음)		스피커 : 개발자 생태계(DEVREL 데브렐) 팀 by Kristine Song (구글 8년차, 3번째 팀이고 이전에는 HR에 있었음)

			== Why communities matter? ==
	~~'''~~Why communities matter?~~'''~~

	- Learn		- Learn

12번째 줄:		10번째 줄:


	최근에는 GitHub, Stackoverflow, 커뮤니티 기여 등 다양한 측면을 살펴봐서 채용을 진행함. 얼마나 배우려고 하는 열정이 있는지 등을 온라인 활동 등을 통해 살펴봄~~.ㅠㅕㅑㅣ야ㅜㅎ ㅛㅐ~~		최근에는 GitHub, Stackoverflow, 커뮤니티 기여 등 다양한 측면을 살펴봐서 채용을 진행함. 얼마나 배우려고 하는 열정이 있는지 등을 온라인 활동 등을 통해 살펴봄


	~~'''~~Building your tech career - Growth opportunities~~'''~~		== Building your tech career - Growth opportunities ==


29번째 줄:		26번째 줄:
	Google Developer Experts 가 국내에 13명 있음		Google Developer Experts 가 국내에 13명 있음

	= 레퍼런스 =		== 레퍼런스 ==

	* 행사 홈페이지 https://festa.io/events/4385		* 행사 홈페이지 https://festa.io/events/4385
	* Google Developer Groups https://developers.google.com/community/gdg		* Google Developer Groups https://developers.google.com/community/gdg

Ryanyang: 새 문서: = Building Your Tech Career with Developer Communities = 스피커 : 개발자 생태계(DEVREL 데브렐) 팀 by Kristine Song (구글 8년차, 3번째 팀이고 이전에는 HR에 있었음) '''Why communities matter?''' - Learn - Connect - Inspire 최근에는 GitHub, Stackoverflow, 커뮤니티 기여 등 다양한 측면을 살펴봐서 채용을 진행함. 얼마나 배우려고 하는 열정이 있는지 등을 온라인 활동 등을 통해 살펴봄.ㅠㅕㅑㅣ...

2023-12-09T04:24:24Z

새 문서: = Building Your Tech Career with Developer Communities = 스피커 : 개발자 생태계(DEVREL 데브렐) 팀 by Kristine Song (구글 8년차, 3번째 팀이고 이전에는 HR에 있었음) '''Why communities matter?''' - Learn - Connect - Inspire 최근에는 GitHub, Stackoverflow, 커뮤니티 기여 등 다양한 측면을 살펴봐서 채용을 진행함. 얼마나 배우려고 하는 열정이 있는지 등을 온라인 활동 등을 통해 살펴봄.ㅠㅕㅑㅣ...

새 문서

= Building Your Tech Career with Developer Communities =
스피커 : 개발자 생태계(DEVREL 데브렐) 팀 by Kristine Song (구글 8년차, 3번째 팀이고 이전에는 HR에 있었음)

'''Why communities matter?'''

- Learn

- Connect

- Inspire

최근에는 GitHub, Stackoverflow, 커뮤니티 기여 등 다양한 측면을 살펴봐서 채용을 진행함. 얼마나 배우려고 하는 열정이 있는지 등을 온라인 활동 등을 통해 살펴봄.ㅠㅕㅑㅣ야ㅜㅎ ㅛㅐ

'''Building your tech career - Growth opportunities'''

low hanging magic fruits : 튜토리얼 만들기, 오픈소스 기여, 행사 발표 등

high hanging magic fruits : 스타트업 창업 등

low hanging common fruits : 커뮤니티 참여, 책 읽기 등

많은 노력이 드는 데 효과가 없는 일은 할 필요 X. 여힝이나 가라.

Google Developer Experts 가 국내에 13명 있음

= 레퍼런스 =

* 행사 홈페이지 https://festa.io/events/4385
* Google Developer Groups https://developers.google.com/community/gdg