Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ignite 2024 #194

Open
wants to merge 118 commits into
base: ignite2024
Choose a base branch
from
Open

Ignite 2024 #194

wants to merge 118 commits into from

Conversation

sudivate
Copy link

@sudivate sudivate commented Oct 22, 2024 •
edited
Loading

  1. Combined Contoso frontend and backend into one repo with updated AZD deployment in Azure.
  2. Added User feedback collection (Thumbs Up and Thumbs Down) through the frontend chat interface and dedicated endpoint to collect feedback as OTEL signals to App Insights.
  3. Use Azure AI Inference SDK and Azure Tracing SDK (Compatible with OTEL Semantic Conventions for Gen AI)
    4.Created an evaluation pipeline using Azure AI Evaluation SDK, based on captured data in App Insights, and submitting the evaluation scores back to App Insights.
  4. Enabled local OTEL signal visualization using Aspire Dashboard, seamlessly integrated with the VS Code experience.
  5. Developed an App Insights workbook to visualize telemetry signals in production, monitoring performance, quality, and cost.

Note: This PR involves major changes and considering the size it can be difficult to review, please feel to reach out for any additional context

sudivate and others added 30 commits September 10, 2024 16:32
@sudivate
Azure Core Tracing Opentelemetry sample
76f7d75
@sudivate
Merge branch 'main' of https://github.com/sudivate/contoso-chat into …
1f0769b 
…sudivate/otel
@sudivate
model deployment version
e350637 
Signed-off-by: sudivate <[email protected]>
@joshuaphelpsms
set up azure monitor
73d67ab
@joshuaphelpsms
fix import
a4a42e5
@sudivate
Merge branch 'Azure-Samples:main' into ms-hack-24
8975034
@sudivate
ai inference otel instrumentation sample
4411fe6 
Signed-off-by: sudivate <[email protected]>
@sudivate
Merge pull request #2 from sudivate/sudivate/otel
c2e520c 
Updated AI inference sample with instrumentation
@sudivate
core package
7878ebe 
Signed-off-by: sudivate <[email protected]>
@sudivate
Merge pull request #3 from sudivate/sudivate/azure-core
6f55f7c 
core package
@joshuaphelpsms
Merge branch 'ms-hack-24' into josh/azure-core-tracing
7e7ed02
@joshuaphelpsms
add otlp exporters
ed8e6f4
@joshuaphelpsms
Merge pull request #1 from sudivate/josh/azure-core-tracing
a551ace 
use azure core tracing with App Insights and OTLP
@sudivate
add new requirements
c765c2d 
Signed-off-by: sudivate <[email protected]>
@sudivate
add api test
e86ea52 
Signed-off-by: sudivate <[email protected]>
@sudivate
replace prompty with Azure AI inference SDK
af673d5 
Signed-off-by: sudivate <[email protected]>
@sudivate
Merge pull request #4 from sudivate/sudivate/az-ai-inference
7068442 
Sudivate/az ai inference
@sudivate
ai inference instrumentation
f1e685d 
Signed-off-by: sudivate <[email protected]>
@sudivate
get started doc
d2c5d8a 
Signed-off-by: sudivate <[email protected]>
@sudivate
Merge pull request #5 from sudivate/sudivate/ai-inference-instrumenta…
58466b1 
…tion

OTEL instrumentation for AI inference SDK
@mcollier
Copy azure-core wheel package to container. (#6)
92ab634
@joshuaphelpsms
add rest client extension
5f5898e
@mcollier
Setup Cosmos DB roles. (#8)
cd358a0 
* Add user to Cosmos roles.

* Check if user is logged into Azure CLI.
@joshuaphelpsms
Merge pull request #7 from sudivate/josh/add-rest-client-ext
d23e060 
add rest client extension
@mcollier
Startup command to install API requirements.
3ea7913
@mcollier
Clarify startup steps.
fbf4c1d
@MS-Santi
New api endpoint
c0e3220
@mcollier
Modify create-response to accept JSON-formatted object; Install new A…
98b54e1 
…zureCore package in Dockerfile.
@joshuaphelpsms
add llm spans
5f51934
@mcollier
Set working directory for debugging.
a4163ea
@sudivate
update post deployment hooks
a29f478 
Signed-off-by: sudivate <[email protected]>
@sudivate
parameterize workbook
2eec22c 
Signed-off-by: sudivate <[email protected]>
@sudivate
updated workbook
27df1de 
Signed-off-by: sudivate <[email protected]>
@sudivate
changes for new tracing package
7e1449d 
Signed-off-by: sudivate <[email protected]>
@sudivate
changes wrt to new tracing sdk
e905359 
Signed-off-by: sudivate <[email protected]>
@sudivate
update workbook
6449634 
Signed-off-by: sudivate <[email protected]>
@sudivate
update eval and feedback semantics
4c5d8be 
Signed-off-by: sudivate <[email protected]>
@sudivate
update workbook
046cab6 
Signed-off-by: sudivate <[email protected]>
@sudivate
Merge pull request #24 from sudivate/sudivate/containerapps
f10735a 
Front end and backend deployment and improved workbook
@sudivate
Merge branch 'main' of https://github.com/sudivate/contoso-chat into …
5b32ec8 
…ms-hack-24

Signed-off-by: sudivate <[email protected]>
@sudivate
merge from main
712d83a 
Signed-off-by: sudivate <[email protected]>
@sudivate
eval update
e99283b 
Signed-off-by: sudivate <[email protected]>
@sudivate
Merge branch 'main' into ms-hack-24
665e4a3
@sudivate sudivate closed this Oct 22, 2024
@sudivate sudivate reopened this Oct 23, 2024
@sudivate sudivate marked this pull request as ready for review October 23, 2024 20:48
@sudivate sudivate closed this Oct 23, 2024
@sudivate
update ai inference package
8ce7067 
Signed-off-by: sudivate <[email protected]>
@sudivate
contoso compatible workbook
f24d369 
Signed-off-by: sudivate <[email protected]>
@sudivate
add observability
d2f9b51 
Signed-off-by: sudivate <[email protected]>
@sudivate
typo
e1ec7e1 
Signed-off-by: sudivate <[email protected]>
@sudivate
testing instructions
0940bed 
Signed-off-by: sudivate <[email protected]>
@sudivate sudivate reopened this Oct 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@sudivate @joshuaphelpsms @mcollier @MS-Santi @Abdulk084