Skip to content

Commit

Permalink
Update description, minor cleanup of README.md and tests (#209)
Browse files Browse the repository at this point in the history
* Update project short description
* remove broken separator from README.md benchmarks table
* mark proactive injections test as load tests
  • Loading branch information
jamie256 authored Dec 8, 2023
1 parent 9a50eee commit 25f88ac
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 2 deletions.
1 change: 0 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,6 @@ You can have more information about the different modules and their metrics [her
| c5.xlarge | Light metrics | 2335 chats/sec |
| | LLM metrics | 8.2 chats/sec |
| | All metrics | 0.28 chats/sec |
| ----------------- | :-----------: | -------------: |
| g4dn.xlarge | Light metrics | 2492 chats/sec |
| | LLM metrics | 23.3 chats/sec |
| | All metrics | 1.79 chats/sec |
Expand Down
2 changes: 2 additions & 0 deletions langkit/tests/test_proactive_injection.py
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,7 @@ def mock_proactive_injection_detection():
return mock_proactive_injection_detection


@pytest.mark.load
def test_proactive_injection_detection(mock_proactive_injection_detection):
os.environ["OPENAI_API_KEY"] = "<your-key>"
openai.api_key = os.getenv("OPENAI_API_KEY")
Expand All @@ -52,6 +53,7 @@ def test_proactive_injection_detection(mock_proactive_injection_detection):
assert result["score"] == 1


@pytest.mark.load
@patch("langkit.extract")
def test_proactive_injection_detection_extract(mock_get):
os.environ["OPENAI_API_KEY"] = "<your-key>"
Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
[tool.poetry]
name = "langkit"
version = "0.0.27"
description = "A collection of text metric udfs for whylogs profiling and monitoring in WhyLabs"
description = "A language toolkit for monitoring LLM interactions"
authors = ["WhyLabs.ai <[email protected]>"]
homepage = "https://docs.whylabs.ai/docs/large-language-model-monitoring"
license = "Apache-2.0"
Expand Down

0 comments on commit 25f88ac

Please sign in to comment.