Code

Dataset to replace daily dialog #50

Code

Open

shachihk-intel wants to merge 19 commits intomainIntelLabs/ConvAssist:mainfrom shachi_datasetIntelLabs/ConvAssist:shachi_datasetCopy head branch name to clipboard

+1,477-658

Commits

Commits on Dec 13, 2024

• adding processed human conversation dataset

  shachihk-intel

  committed
  00d02f8

  Copy full SHA for 00d02f8

Commits on Dec 14, 2024

• adding processed persona chat (train set)

  shachihk-intel

  committed
  972ef16

  Copy full SHA for 972ef16

• scripts to process persona chat and human conv dataset, and original files

  shachihk-intel

  committed
  3b3c038

  Copy full SHA for 3b3c038

Commits on Dec 15, 2024

• Add README and LICENSE for Human Conversation Training Data; implement dataset download script

  michaelbeale-IL

  committed
  f44cc1f

  Copy full SHA for f44cc1f

• Rename processed_personachat.txt to personachat.txt and update processing script; add README for Personachat dataset

  michaelbeale-IL

  committed
  4b65705

  Copy full SHA for 4b65705

• Update README.md

  michaelbeale-IL

  authored
  11d7914

  Copy full SHA for 11d7914

Commits on Dec 16, 2024

• Add dataset download script and clean up: remove old download scripts for Human Conversation and Persona Chat datasets; update dependencies in pyproject.toml

  michaelbeale-IL

  committed
  6575461

  Copy full SHA for 6575461

• Update .gitignore to exclude Human Conversation and Persona Chat dataset files

  michaelbeale-IL

  committed
  70d40ab

  Copy full SHA for 70d40ab

• Add README for 3rd Party Resources, detailing datasets and usage guidelines

  michaelbeale-IL

  committed
  c6e9c34

  Copy full SHA for c6e9c34

Commits on Dec 18, 2024

• Fix predictors (#52)

  Show description for f2732f2
  michaelbeale-IL

  committed
  f2732f2

  Copy full SHA for f2732f2

• Add dataset download script and clean up: remove old download scripts for Human Conversation and Persona Chat datasets; update dependencies in pyproject.toml

  michaelbeale-IL

  committed
  9fe0c65

  Copy full SHA for 9fe0c65

• Remove outdated dependencies from pyproject.toml

  michaelbeale-IL

  committed
  e1aa394

  Copy full SHA for e1aa394

Commits on Dec 20, 2024

• Fixed

  michaelbeale-IL

  committed
  ad944e3

  Copy full SHA for ad944e3

• Refactor n-gram utilities: remove unused imports, streamline database connection handling, and enhance batch insertion logic

  michaelbeale-IL

  committed
  886d884

  Copy full SHA for 886d884

Commits on Dec 24, 2024

• Testing refactoring

  michaelbeale-IL

  committed
  85af660

  Copy full SHA for 85af660

Commits on Jan 7, 2025

• deleted test database.

  michaelbeale-IL

  committed
  b2cbdf0

  Copy full SHA for b2cbdf0

• Remove commented-out thread creation in database generator

  michaelbeale-IL

  committed
  4e6dcb9

  Copy full SHA for 4e6dcb9

Commits on Jan 16, 2025

• Format code: adjust spacing and improve readability in database generator and dataset download scripts

  michaelbeale-IL

  committed
  b74e8f4

  Copy full SHA for b74e8f4

• Merge branch 'main' into shachi_dataset

  michaelbeale-IL

  committed
  b23e98b

  Copy full SHA for b23e98b