How do I clean messy web-scraped text for NLP?
I am scraping product reviews from a website, and the text is full of HTML tags, broken links, and strange formatting. My current regex approach is getting really complicated.What is the best way to s...
How do I deal with huge batch sizes in NLP?
I am training a Transformer, and I keep getting memory errors because my batch size is too big. If I drop it to 1, the model takes forever to train and the loss is extremely unstable.Is there a trick ...
Are Coursera certificates actually recognized by employers?
I am working through a few NLP courses on Coursera and I am worried about the return on investment. I have heard mixed things about whether HR teams actually care about these specific certificates.If ...
Which vectorization method is best for small text datasets?
I am working on a classification project with only about 500 short text strings. Using heavy pre-trained transformer models feels like overkill and is taking way too long to train.Would it be more eff...
How do I handle emojis in text classification?
My current preprocessing script deletes all emojis, but I have a feeling that emojis are actually very important for sentiment analysis. 'Happy' vs 'Happy with a crying face' changes the meaning compl...
What is the role of feature engineering in NLP?
In my machine learning classes, I hear a lot about feature engineering. But in NLP, it seems like we just throw text into a tokenizer and then into a model. Is feature engineering dead?What kind of 'h...
Is it better to build from scratch or use an API?
I am deciding whether to use the OpenAI API for a project or to build and host my own small model using Hugging Face. The project involves analyzing user feedback.For a beginner, which is the better l...
How do I handle non-standard grammar in NLP?
I am analyzing customer support tickets, and the writing is often filled with poor grammar, run-on sentences, and missing punctuation. My standard model seems to ignore these sentences or fails to tok...
What are the common pitfalls in data preprocessing for LLMs?
I feel like my model is performing poorly because of my data. What are the most common mistakes people make when cleaning and preprocessing their datasets for LLM training? Are things like removing pu...
What is the best way to format a dataset for instruction tuning?
I am preparing a dataset for an instruction-tuned model, but I keep seeing different formats like ChatML or Alpaca. Does it really matter which format I use, or is it just about the quality of the Q&A...
