Skip to content

Cross-cultural Inspiration Detection and Analysis in Real and LLM-generated Social Media Data

License

Notifications You must be signed in to change notification settings

MichiganNLP/cross_inspiration

Repository files navigation

Cross-cultural Inspiration Detection and Analysis in Real and LLM-generated Social Media Data

This repository contains the dataset and code for our paper.

Task Description

We compare AI-generated and human-written inspiring Reddit content across India and the UK. Although there may not be any visible differences to the human eye, by using linguistic methods, we find significant syntactic and lexical cross-cultural differences between generated and real inspiring posts.

Data

The final data is available at all_data All annotations are available in `all_annotations'

Features

Topic Modeling features can be accessed interactively in topic_analysis

Models

GPT-4 generation

All generation code is available at LLM_generation.

Inspiration Detection models

Random Forest, Naive Bayes, SVM models are available at baselines.

XLM-Roberta is available at roberta.

Llama-2-7b model with LoRA fine-tuning is available at llama.

About

Cross-cultural Inspiration Detection and Analysis in Real and LLM-generated Social Media Data

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published