Skip to content

Using test parameter to feed BAAS URL to device farm #191

Using test parameter to feed BAAS URL to device farm

Using test parameter to feed BAAS URL to device farm #191

GitHub Actions / Unit Test Results - Android Sync (Emulator) failed Jan 27, 2024 in 1s

Unit Test Results - Android Sync (Emulator) ❌

Tests failed

❌ ./packages/test-sync/build/outputs/androidTest-results/connected/TEST-test(AVD) - 13-_test-sync-.xml

417 tests were completed in 1037s with 397 passed, 1 failed and 19 skipped.

Test suite Passed Failed Skipped Time
io.realm.kotlin.test.mongodb.common.ApiKeyAuthTests 397✅ 1❌ 19⚪ 1037s

❌ io.realm.kotlin.test.mongodb.common.ApiKeyAuthTests

✅ fetch_nonExistingKeyThrows
✅ create
✅ delete
✅ enable
✅ getApp
✅ delete_nonExisitingKeyNoOps
✅ create_throwsWithInvalidName
✅ getUser
✅ enable_alreadyEnabled
✅ fetch
✅ callMethodWithLoggedOutUser
✅ fetchAll
✅ create_throwsWithNoName
✅ fetchAll_noExistingKeysGiveEmptyList
⚪ callMethodsWithApiKeysDisabled
✅ disable_alreadyDisabled
✅ disable
✅ enable_nonExistingKeyThrows
✅ disable_nonExistingKeyThrows
io.realm.kotlin.test.mongodb.common.AppConfigurationTests
  ✅ appName_defaultValue
  ✅ multiplexing_default
  ✅ encryptionKey_isCopy
  ✅ create
  ✅ syncRootDirectory_appendDirectoryToPath
  ✅ appName_invalidValuesThrows
  ✅ appName
  ✅ syncRootDirectory_writeProtectedDir
  ✅ syncTimeOutOptions_throwsIfValuesAreOutOfRange
  ✅ syncTimeOutOptions_default
  ✅ baseUrl
  ✅ encryptionKey
  ✅ defaultLoginInfoObfuscator
  ✅ syncRootDirectory
  ✅ addCustomRequestHeader
  ✅ multiplexing
  ✅ appVersion_defaultValue
  ✅ authorizationHeaderName
  ✅ injectedBundleId
  ✅ appVersion_invalidValuesThrows
  ✅ logLevelDoesNotGetOverwrittenByConfig
  ✅ syncRootDirectory_default
  ✅ baseUrl_defaultValue
  ✅ appVersion
  ✅ customHeadersTest
  ✅ syncTimeOutOptions
  ✅ httpLogObfuscator_null
  ✅ encryptionKey_illegalValueThrows
io.realm.kotlin.test.mongodb.common.AppTests
  ✅ login_Anonymous
  ✅ encryptedMetadataRealm_openWithoutKeyThrows
  ✅ login_invalidCredentialsThrows
  ✅ authenticationChangeAsFlow_throwsWhenExceedCapacity
  ✅ currentUser
  ✅ defaultApp
  ✅ authenticationChangeAsFlow
  ✅ defaultApp_emptyIdThrows
  ✅ login_NonCredentialImplThrows
  ✅ currentUser_FallbackToNextValidUser
  ✅ encryptedMetadataRealm_openWithWrongKeyThrows
  ✅ authenticationChangeAsFlow_removeUser
  ✅ allUsers
  ✅ encryptedMetadataRealm
  ⚪ currentUser_clearedAfterUserIsRemoved
  ✅ authenticationChangeAsFlow_deleteUser
  ✅ allUsers_retrieveRemovedUser
io.realm.kotlin.test.mongodb.common.AsymmetricSyncTests
  ✅ asymmetricSchema
  ⚪ insert
  ✅ mutableDynamicRealm_insert_unsuportedType
  ✅ mutableDynamicRealm_query_throws
  ✅ realmClassSchema_isAsymmetric
  ✅ findLatestThrows
  ✅ nestedEmbeddedHierarchyIsQueryable
  ✅ insert_samePrimaryKey_throws
  ✅ mutableDynamicRealm_delete_throws
  ✅ deleteAll_doNotDeleteAsymmetricObjects
  ✅ mutableDynamicRealm_copyToRealm_throws
io.realm.kotlin.test.mongodb.common.CredentialsTests
  ✅ loginUsingCredentials
  ✅ allCredentials_emptyInputThrows
  ✅ allCredentials
  ✅ anonymousLogin
  ❌ customFunction_authExceptionThrownOnError
	java.lang.AssertionError: The exception message did not match.
io.realm.kotlin.test.mongodb.common.EmailPasswordAuthWithAutoConfirmTests
  ✅ registerUser
  ✅ registerUser_invalidServerArgsThrows_invalidUser
  ✅ callResetPasswordFunction_invalidServerArgsThrows
  ✅ callResetPasswordFunction_invalidArgumentsThrows
  ✅ callResetPasswordFunction
  ✅ sendResetPasswordEmail_noUserThrows
  ✅ resendConfirmationEmail_userAlreadyConfirmedThrows
  ⚪ resetPassword
  ⚪ confirmUser
  ✅ resendConfirmationEmail_invalidArgumentsThrows
  ✅ registerUser_sameUserThrows
  ✅ registerUser_invalidServerArgsThrows_invalidPassword
  ✅ sendResetPasswordEmail_invalidArgumentsThrows
  ✅ resetPassword_invalidArgumentsThrows
  ✅ confirmUser_invalidArgumentsThrows
  ✅ confirmUser_invalidServerArgsThrows
  ⚪ resetPassword_noUserFoundThrows
  ✅ resetPassword_wrongArgumentTypesThrows
  ⚪ confirmUser_alreadyConfirmedThrows
  ✅ sendResetPasswordEmail
io.realm.kotlin.test.mongodb.common.EmailPasswordAuthWithCustomFunctionTests
  ✅ retryCustomConfirmation
  ✅ retryCustomConfirmation_noUserThrows
  ✅ retryCustomConfirmation_failConfirmation
  ✅ retryCustomConfirmation_invalidArgumentsThrows
  ✅ retryCustomConfirmation_alreadyConfirmedThrows
io.realm.kotlin.test.mongodb.common.EmailPasswordAuthWithEmailConfirmTests
  ✅ resendConfirmationEmail
  ✅ resendConfirmationEmail_noUserThrows
io.realm.kotlin.test.mongodb.common.FlexibleSyncConfigurationTests
  ✅ equals
  ⚪ initialSubscriptions_failures_shouldDeleteRealm
  ✅ equals_same
  ✅ toString_nonEmpty
  ✅ initialSubscriptions_throwsOnPartitionBasedConfig
  ✅ defaultPath
  ✅ with
  ✅ initialSubscriptions
  ✅ initialSubscriptions_rerunOnOpen_true
  ✅ equals_not
  ✅ initialSubscriptions_rerunOnOpen_false
  ✅ durability
  ✅ overrideDefaultPath
  ✅ hashCode_notEquals
  ✅ hashCode_equal
io.realm.kotlin.test.mongodb.common.FlexibleSyncIntegrationTests
  ✅ dataIsDeletedWhenSubscriptionIsRemoved
  ✅ rerunningInitialSubscriptionsAndWaitForInitialRemoteData
  ✅ downloadInitialData
  ✅ writeFailsIfNoSubscription
  ✅ compensationWrite_writeOutsideOfSubscriptionsGetsReveredByServer
  ✅ initialSubscriptions_timeOut
  ✅ roundTripLinkedAndEmbeddedObjects
io.realm.kotlin.test.mongodb.common.FunctionsTests
  ✅ callFunction_null
  ✅ callFunction_void
  ✅ getApp
  ✅ exhaustiveElementClassifiersTest
  ✅ callFunction_authorizedOnly
  ✅ callFunction_afterLogout
  ✅ getUser
  ✅ exhaustiveBsonTypesTest
  ✅ callFunction_sum
  ✅ unknownFunction
  ✅ exhaustiveCollectionTest
  ✅ unsupportedReturnTypeThrows
  ✅ unsupportedArgumentTypeThrows
  ✅ callFunction_remoteError
io.realm.kotlin.test.mongodb.common.GeoSpatialTests
  ✅ write
  ✅ write_outsideSubscriptionsFail
  ✅ geoCircle_tests
  ✅ geoPolygon_tests
  ✅ geoBox_tests
io.realm.kotlin.test.mongodb.common.HttpLogObfuscatorTests
  ✅ apple_login
  ✅ nullObfuscator
  ✅ customFunction
  ✅ facebook_login
  ✅ apiKey_createAndLogin
  ✅ jwtToken_login
  ✅ googleAuthToken_login
  ✅ emailPassword_registerAndLogin
io.realm.kotlin.test.mongodb.common.MutableSubscriptionSetTests
  ✅ removeSubscription_success
  ✅ addNamedSubscription
  ✅ removeAllStringTyped
  ✅ iterator_duringWrite
  ✅ removeAll_anonymouslyOnly
  ✅ update
  ✅ removeAllClassTyped
  ✅ add_conflictingNamesThrows
  ✅ removeNamed
  ✅ addAnonymousSubscription
  ✅ removeAllStringTyped_fails
  ✅ initialSubscriptions
  ✅ addExistingAnonymous_returnsAlreadyPersisted
  ⚪ deleteFile_exceptionInsideMutableRealm
  ✅ removeAllClassTyped_fails
  ✅ removeSubscription_fails
  ✅ addExistingNamed_returnsAlreadyPersisted
  ✅ add_multiple_anonymous
  ✅ removeAll
  ✅ removeNamed_fails
  ✅ removeAll_fails
io.realm.kotlin.test.mongodb.common.ProgressListenerTests
  ✅ completesOnClose
  ✅ uploadProgressListener_changesOnly
  ✅ downloadProgressListener_indefinitely
  ✅ worksAfterExceptions
  ✅ throwsOnFlexibleSync
  ✅ worksAfterCancel
  ✅ triggerImmediatelyWhenRegistered
  ✅ downloadProgressListener_changesOnly
  ✅ uploadProgressListener_indefinitely
io.realm.kotlin.test.mongodb.common.SubscriptionExtensionsTests
  ✅ realmResults_subscribe_waitFirstTime
  ✅ realmQuery_subscribe_waitNever
  ✅ realmQuery_subscribe_waitFirstTime
  ✅ anonymousSubscriptionsOverlap
  ✅ realmQuery_subscribe_waitAlways
  ✅ realmQuery_subscribe_anonymousTwice
  ✅ realmResults_subscribe_waitOnNever
  ✅ realmResults_subscribe_throwsInsideWrite
  ✅ updatingOnlyQueryWillTriggerFirstTimeBehavior
  ✅ realmQuery_subscribe_queryResultIsLatestVersion
  ✅ realmQuery_subscribe_anonymous
  ✅ realmResults_subscribe_waitAlways
  ✅ realmResults_subscribe_timeOut_fails
  ✅ realmQuery_subscribe_throwsInsideWrite
  ✅ realmResults_subscribe_subquery
  ✅ realmQuery_subscribe_timeOut_fails
io.realm.kotlin.test.mongodb.common.SubscriptionSetTests
  ✅ waitForSynchronizationInitialSubscriptions
  ✅ waitForSynchronization_success
  ✅ waitForSynchronization_timeOut
  ✅ iterator_zeroSize
  ✅ waitForSynchronization_errorOnDescriptors
  ✅ findByName
  ✅ subscriptions_throwsOnClosedRealm
  ✅ realmSubscriptionsReturnSameInstance
  ✅ size
  ✅ state
  ✅ initialSubscriptions
  ✅ waitForSynchronization_timeOutFails
  ✅ findByQuery
  ✅ iterator
  ✅ errorMessage
  ✅ subscriptions_failOnNonFlexibleSyncRealms
  ✅ waitForSynchronization_error
  ✅ waitForSynchronizationInitialEmptySubscriptionSet
  ✅ methodsOnClosedRealm
io.realm.kotlin.test.mongodb.common.SubscriptionTests
  ✅ equals_falseForDifferentVersions
  ✅ equals
  ✅ asQuery
  ✅ properties_areSnaphotValues
  ✅ asQuery_throwsOnWrongType
  ✅ managedProperties
io.realm.kotlin.test.mongodb.common.SyncClientResetIntegrationTests
  ✅ recoverUnsyncedChanges_recoverFails_flx
  ✅ recoverUnsyncedChanges_recoverFails_pbs
  ✅ recoverUnsyncedChanges_recover_flx
  ✅ recoverUnsyncedChanges_recover_pbs
  ✅ recoverOrDiscardUnsyncedChanges_recover_flx
  ✅ recoverOrDiscardUnsyncedChanges_recover_pbs
  ✅ discardUnsyncedChanges_discards_attemptRecover_flx
  ✅ discardUnsyncedChanges_discards_attemptRecover_pbs
  ✅ recoverUnsyncedChanges_executeClientReset_flx
  ✅ recoverUnsyncedChanges_executeClientReset_pbs
  ✅ recoverOrDiscardUnsyncedChanges_discards_flx
  ✅ recoverOrDiscardUnsyncedChanges_discards_pbs
  ✅ manuallyRecoverUnsyncedChanges_reported_flx
  ✅ manuallyRecoverUnsyncedChanges_reported_pbs
  ✅ manuallyRecoverUnsyncedChanges_executeClientReset_flx
  ✅ manuallyRecoverUnsyncedChanges_executeClientReset_pbs
  ✅ discardUnsyncedChanges_userExceptionCaptured_onBeforeReset_flx
  ✅ discardUnsyncedChanges_userExceptionCaptured_onBeforeReset_pbs
  ✅ discardUnsyncedChanges_discards_flx
  ✅ discardUnsyncedChanges_discards_pbs
  ✅ recoverOrDiscardUnsyncedChanges_executeClientReset_flx
  ✅ recoverOrDiscardUnsyncedChanges_executeClientReset_pbs
  ✅ discardUnsyncedChanges_failure_flx
  ✅ discardUnsyncedChanges_failure_pbs
  ✅ defaultRecoverOrDiscardUnsyncedChanges_logsReported_flx
  ✅ defaultRecoverOrDiscardUnsyncedChanges_logsReported_pbs
  ✅ discardUnsyncedChanges_userExceptionCaptured_onAfterReset_flx
  ✅ discardUnsyncedChanges_userExceptionCaptured_onAfterReset_pbs
  ✅ recoverUnsyncedChanges_resetErrorHandled_flx
  ✅ recoverUnsyncedChanges_resetErrorHandled_pbs
  ✅ discardUnsyncedChanges_executeClientReset_flx
  ✅ discardUnsyncedChanges_executeClientReset_pbs
io.realm.kotlin.test.mongodb.common.SyncClientTests
  ✅ reconnect_noRealms
  ✅ waitForSessionsToTerminate
  ✅ hasSyncSessions
  ✅ waitForSessionsToTerminate_noRealms
  ✅ hasSyncSessions_noRealms
  ✅ sync
  ✅ reconnect
io.realm.kotlin.test.mongodb.common.SyncConfigTests
  ✅ name_partitionBasedDefaultName
  ✅ syncClientResetStrategy_automatic
  ✅ name_withoutFileExtension
  ✅ clientResetStrategy_automatic
  ✅ logConfiguration
  ✅ with_throwsIfNotLoggedIn
  ✅ encryption
  ✅ syncClientResetStrategy_flexibleBased
  ⚪ getPartitionValue
  ✅ name_illegalValueThrows
  ✅ useConfigOnOtherThread
  ✅ toString_nonEmpty
  ✅ syncClientResetStrategy_partitionBased_defaultNotNull
  ✅ clientResetStrategy_manual
  ✅ name_similarToDefaultObjectStoreName
  ✅ encryption_wrongLength
  ✅ equals_sameObject
  ✅ compactOnLaunch_default
  ✅ compactOnLaunch
  ✅ getInitialRemoteDataTimeout
  ✅ name_withDotRealmFileExtension
  ✅ syncClientResetStrategy_automaticOrDiscard
  ✅ name_emptyValueThrows
  ✅ equals_syncSpecificFields
  ✅ allPartitionTypes
  ✅ syncClientResetStrategy_partitionBased
  ✅ shouldWaitForInitialRemoteData
  ✅ errorHandler
  ✅ supportedSchemaTypesWhenCreatingSyncConfiguration_flexibleSync
  ✅ logLevelDoesNotGetOverwrittenByConfig
  ✅ name_otherFileExtension
  ✅ recoverUnsyncedChangesStrategyMode
  ✅ clientResetStrategy_automaticOrDiscard
  ✅ initialData
  ✅ recoverOrDiscardUnsyncedChangesStrategyMode
  ✅ supportedSchemaTypesWhenCreatingSyncConfiguration_partitionBased
  ✅ syncClientResetStrategy_defaultNotNull
  ✅ errorHandler_default
  ✅ unsupportedSchemaTypesThrowException_flexibleSync
  ✅ unsupportedSchemaTypesThrowException_partitionBasedSync
io.realm.kotlin.test.mongodb.common.SyncSessionTests
  ✅ downloadAllServerChanges_illegalArgumentThrows
  ✅ connectionState_asFlow
  ✅ syncSessionFromErrorHandlerCannotUploadAndDownloadChanges
  ✅ uploadAllLocalChanges_illegalArgumentThrows
  ✅ downloadAllServerChanges_returnFalseOnTimeOut
  ✅ connectionState_completeOnClose
  ✅ sessionResumeMultipleTimes
  ✅ getUser
  ✅ syncingObjectIdFromMongoDB
  ⚪ uploadDownload_throwsUnderlyingSyncError
  ✅ session_identity
  ✅ syncingObjectIdFromRealm
  ✅ sessionPauseMultipleTimes
  ✅ connectionState
  ✅ getConfiguration
  ✅ uploadAllLocalChanges_returnFalseOnTimeOut
  ⚪ getConfiguration_inErrorHandlerThrows
  ✅ session_sharedStateBetweenRealms
  ⚪ uploadAndDownloadChangesSuccessfully
  ✅ session_localRealmThrows
  ✅ session
  ✅ sessionPauseAndResume
io.realm.kotlin.test.mongodb.common.SyncedRealmTests
  ✅ writeCopyTo_flexibleSyncToLocal
  ✅ mutableRealmInt_convergesAcrossClients
  ✅ canOpenWithRemoteSchema
  ⚪ waitForInitialData_resilientInCaseOfRetries
  ✅ waitForInitialRemoteData
  ✅ writeCopyTo_dataNotUploaded_throws
  ✅ deleteRealm
  ✅ initialRealm_flexibleSync
  ✅ writeCopyTo_localToFlexibleSync_throws
  ✅ customLoggersReceiveSyncLogs
  ✅ flexibleSync_throwsWithLocalInitialRealmFile
  ✅ realmAsFlow_acrossSyncedChanges
  ✅ partitionBasedSyncConfig_throwsWithLocalInitialRealmFile
  ⚪ waitForInitialRemoteData_mainThreadThrows
  ✅ errorHandlerReceivesPermissionDeniedSyncError
  ✅ schemaRoundTrip
  ✅ writeCopyTo_partitionBasedToLocal
  ✅ writeCopyTo_flexibleSyncToFlexibleSync
  ✅ canOpen
  ✅ canSync
  ⚪ createInitialRealmPbs
  ✅ accessSessionAfterRemoteChange
  ✅ writeCopyTo_partitionBasedToSamePartitionKey
  ✅ advanceRealmWithoutListening
  ✅ writeCopyTo_partitionBasedToDifferentPartitionKey
  ⚪ createInitialRealmFx
  ✅ initialRealm_partitionBasedSync
  ✅ writeCopyTo_localToPartitionBasedSync
  ⚪ onlyLocalSchemaIsVisible
  ✅ waitForInitialData_timeOut
  ✅ waitForInitialRemoteData_propagateServerErrors
  ✅ testErrorHandler
io.realm.kotlin.test.mongodb.common.UserProfileTests
  ✅ profile
  ✅ profileAsBsonDocument
  ✅ profileEmpty
io.realm.kotlin.test.mongodb.common.UserTests
  ✅ repeatedLogInAndOut
  ✅ customData_refresh
  ✅ getIdentities
  ✅ getAccessToken
  ✅ removeUser_throwsIfUserAlreadyRemoved
  ✅ equals
  ✅ getApp
  ✅ deleteUser_loggedOutThrows
  ✅ getDeviceId
  ✅ logOut
  ✅ logOutUserInstanceImpactsCurrentUser
  ✅ deleteUser_throwsIfUserAlreadyDeleted
  ✅ getId
  ✅ logOutCurrentUserImpactsOtherInstances
  ✅ customData_refreshByLogout
  ✅ linkCredentials_twoEmailAccountsThrows
  ✅ getState_anonymousUser
  ✅ linkCredentials_addingAnonymousToEmailThrows
  ✅ hashCode_user
  ✅ removeUser
  ✅ linkCredentials_linkingWithItselfThrows
  ✅ getProviderType
  ✅ isLoggedIn
  ✅ linkCredentials_emailPassword
  ✅ getState_emailUser
  ✅ getRefreshToken
  ✅ deleteUser
  ✅ customData_initiallyNull
io.realm.kotlin.test.mongodb.common.internal.KtorNetworkTransportTest
  ✅ requestSendsIllegalJson
  ✅ requestSuccessful
  ⚪ errorPropagation
  ✅ requestFailedOnServer
io.realm.kotlin.test.mongodb.common.internal.RealmSyncUtilsTest
  ✅ convertAppError_unmappedErrorCode
  ✅ convertSyncErrorCode_unmappedErrorCode2
  ✅ convertAppError_unmappedErrorCategory
  ✅ convertSyncErrorCode_unknownNativeErrrorCode
  ✅ convertAppError_unmappedErrorCategoryAndErrorCode_linkServerLog
  ✅ convertAppError_unmappedErrorCategoryAndErrorCode_noMessage_linkServerLog
  ✅ convertSyncErrorCode_unmappedErrorCategory
  ✅ convertAppError_unmappedErrorCategoryAndErrorCode_noMessage
io.realm.kotlin.test.mongodb.common.internal.SyncConnectionParamsTests
  ✅ allProperties
io.realm.kotlin.test.mongodb.common.nonlatin.NonLatinTests
  ✅ readNullCharacterFromMongoDB
io.realm.kotlin.test.mongodb.common.serializer.BsonEncoderTests
  ✅ realmAny_decodeUnsupportedTypeThrows
  ✅ decodeFromBsonElement_throwsUnsupportedType
  ✅ realmAnyEncoding
  ✅ convertNumbersWithoutLoosingPrecision
  ✅ decodeFromBsonElement_throwsWrongType
  ✅ encodeToBsonValue
  ✅ decodeBsonElementFromBsonElement
  ✅ encodeBsonValueToBsonValue
  ✅ encodeToString_throwsUnsupportedType
  ✅ convertWrongMapToBsonDocument_throw
  ✅ convertNumbersLoosingPrecision
  ✅ decodeFromBsonElement

Annotations

Check failure on line 32 in packages/test-sync/src/commonTest/kotlin/io/realm/kotlin/test/mongodb/common/utils/Utils.kt

See this annotation in the file changed.

@github-actions github-actions / Unit Test Results - Android Sync (Emulator)

io.realm.kotlin.test.mongodb.common.ApiKeyAuthTests ► io.realm.kotlin.test.mongodb.common.CredentialsTests ► customFunction_authExceptionThrownOnError

Failed test found in:
  ./packages/test-sync/build/outputs/androidTest-results/connected/TEST-test(AVD) - 13-_test-sync-.xml
Error:
  java.lang.AssertionError: The exception message did not match.
Raw output
java.lang.AssertionError: The exception message did not match.

Expected:
[Service][AuthError(4346)] error executing auth function: Error: Authentication failed.

Actual:
[Service][AuthError(4346)] Error: Authentication failed. Server log entry: http://44.196.59.77:33495/groups/65b541700c9b0cd013209e70/apps/65b541710c9b0cd013209e7d/logs?co_id=65b542010c9b0cd01320b08f

at io.realm.kotlin.test.mongodb.common.utils.UtilsKt.assertFailsWithMessage(Utils.kt:32)
at io.realm.kotlin.test.mongodb.common.CredentialsTests.customFunction_authExceptionThrownOnError(CredentialsTests.kt:408)