Skip to main content

Peaks and Pits Playbook 🏔 🕳️️

Table of contents

  • 1 Background information
  • 2 Introduction to Peaks and Pits
  • 3 High-level overview
  • 4 Obtain posts (Step 1)
  • 5 Identify project-specific exemplar peaks and pits (Step 2)
  • 6 The human touch- find the exemplars (Step 3)
  • 7 Fine-tune the SetFit model (Step 4)
  • 8 Run inference over all project data (Step 5)
  • 9 The metal detector, GPT-3.5 (Step 6)
  • 10 Downstream flourishes (Step 7)
  • 11 Resources

View book source

3 High-level overview

3.1 Core steps of a peaks and project

Peaks and pits have gone through many iterations throughout the past year and a half. Currently, the general workflow is

  1. Extract brand/product mentions from Sprinklr (the start of any project)
  2. Classify a sample of posts (of each sentiment) using GPT-3.5 OR one of the latest SetFit model that has been developed (e.g. the one from the previous project) to quickly identify peaks and pits
  3. Human review to select exemplar peaks and pits from these ‘crudely identified posts’
  4. Fine-tune the SetFit model using selected exemplar posts (from current project and previous projects)
  5. Run inference of this fine-tuned model over all of the project specific data
  6. Use GPT-3.5 for an extra layer of classification on identified peaks and pits
  7. Further understanding the identified peak and pit moments
    • 7.a. Conduct topic modelling via BERTopic over peaks and pits separately to identify high level topics for each brand x peak/pit
    • 7.b. Utilize GPT-3.5 for multilabel classification of Brand Love Emotion States in peak and pit posts
Schematic workflow from Project 706

Figure 1.1: Schematic workflow from Project 706

2 Introduction to Peaks and Pits
4 Obtain posts (Step 1)

On this page

  • 3 High-level overview
  • 3.1 Core steps of a peaks and project
  • View source
  • Edit this page

"Peaks and Pits Playbook 🏔 🕳️️" was written by Jamie Hudson. It was last built on 2024-03-08.

This book was built by the bookdown R package.