BUG: Can generate lewd/nsfw images even when safety_checker is enabled

[realmazharhussain]

I am using flux via replicate. Both FLUX schnell & dev can generate NSFW images even when the safety_checker is enabled.

input:

{
  "prompt": "A woman with long, flowing hair is elegantly posed in a luxurious bathtub filled with water, surrounded by opulent decor. She extends her arms gracefully, with water droplets cascading from her fingers. The setting is illuminated by soft, warm light from ornate chandeliers and candles, creating a romantic atmosphere. Fresh flowers are arranged nearby, adding a touch of natural beauty to the scene. A mirror reflects the ambiance, enhancing the overall elegance and tranquility of the moment.",
  "disable_safety_checker": false,
  "seed": 7053013,
  "aspect_ratio": "1:1",
  "output_format": "webp",
  "output_quality": 80
}

output: An nsfw image

Note

Sometimes, you need to try multipe times before it generates an explicit image.

[bugsbex]

And? I'll take that over it the PTSD nightmare fuel of SD3? what's the problem with having pretty hippy chicks topless?

[realmazharhussain]

Google Play Store, my guy. An app cannot use a generative AI model without NSFW-safety in place.

[bonlime]

@realmazharhussain how is this a bug of the model? just use some other safety checker or decrease the tolerance using safety_tolerance parameter