This page contains material related to our paper "Analysis of facial motion patterns during speech using a matrix factorization algorithm", published in the Journal of the Acoustical Society of America 124, 2283-2290 (2008). PDF, 744 KB.
1. "It’s time to go."
2. "If you don’t want these old magazines, throw them out."
3. "Do you want to wash up?"
4. "It’s a real dark night so watch your driving."
5. "I’ll carry the package for you."
6. "Did you forget to shut off the water?"
7. "Fishing in a mountain stream is my idea of a good time."
8. "Fathers spend more time with their children than they used to."
9. "Be careful not to break your glasses!"
10. "I’m sorry."
11. "You can catch the bus across the street."
12. "Call her on the phone and tell her the news."
13. "I’ll catch up with you later."
14. "I’ll think it over."
15. "I don’t want to go to the movies tonight."
16. "If your tooth hurts that much you ought to see a dentist."
17. "Put that cookie back in the box!"
18. "Stop fooling around!"
19. "Time’s up."
20. "How do you spell your name?"
21. "Music always cheers me up."
22. "My brother’s in town for a short while on business."
23. "We live a few miles from the main road."
24. "This suit needs to go to the cleaners."
25. "They ate enough green apples to make them sick for a week."
26. "Where have you been all this time?"
27. "Have you been working hard lately?"
28. "There’s not enough room in the kitchen for a new table."
29. "Where is he?"
30. "Look out!"
31. "I’ll see you right after lunch."
32. "See you later."
33. "White shoes are awful to keep clean."
34. "Stand there and don’t move until I tell you!"
35. "There’s a big piece of cake left over from dinner."
36. "Wait for me at the corner in front of the drugstore."
37. "It’s no trouble at all."
38. "Hurry up!"
39. "The morning paper didn’t say anything about rain this afternoon or tonight."
40. "The phone call’s for you."
The set below was recorded twice, generating two datasets denoted S2a and S2b.
1. "Music always cheers me up."
2. "My brother’s in town for a short while on business."
3. "We live a few miles from the main road."
4. "This suit needs to go to the cleaners."
5. "They ate enough green apples to make them sick for a week."
6. "Where have you been all this time?"
7. "Have you been working hard lately?"
8. "There’s not enough room in the kitchen for a new table."
9. "Where is he?"
10. "Look out!"
11. "I’ll see you right after lunch."
12. "See you later."
13. "White shoes are awful to keep clean."
14. "Stand there and don’t move until I tell you!"
15. "There’s a big piece of cake left over from dinner."
16. "Wait for me at the corner in front of the drugstore."
17. "It’s no trouble at all."
18. "Hurry up!"
19. "The morning paper didn’t say anything about rain this afternoon or tonight."
20. "The phone call’s for you."
21. "Believe me!"
22. "Let’s get a cup of coffee."
23. "Let’s get out of here before it’s too late."
24. "I hate driving at night."
25. "There was water in the cellar after that heavy rain yesterday."
26. "She’ll only be gone a few minutes."
27. "How do you know?"
28. "Children like candy."
29. "If we don’t get rain soon, we’ll have no grass."
30. "They’re not listed in the new phone book."
31. "Where can I find a place to park?"
32. "I like those big red apples we always get in the fall."
33. "You’ll get fat eating candy."
34. "The show’s over."
35. "Why don’t they paint their walls some other color?"
36. "What’s new?"
37. "What are you hiding under your coat?"
38. "How come I should always be the one to go first?"
39. "I’ll take sugar and cream in my coffee."
40. "Wait just a minute!"
41. "Breakfast is ready."
42. "I don’t know what’s wrong with the car, but it won’t start."
43. "It sure takes a sharp knife to cut this meat."
44. "I haven’t read a newspaper since we bought a television set."
45. "Weeds are spoiling the yard."
46. "Call me a little later!"
47. "Do you have change for a five-dollar bill?"
48. "How are you?"
49. "I’d like some ice cream with my pie."
50. "I don’t think I’ll have any dessert."
Below are computer generated movies with animations of the productions of the indicated sentences, when using a subset of 10 independent facial points to drive the facial model. In each movie, the red points indicate the position of the 10 driving markers.
The movies are in AVI format, compressed with Microsoft MPEG-4 VKI codec V2.
"I’ll see you right after lunch" (1.7 MB)
"See you later" (1.1 MB)
"White shoes are awful to keep clean" (1.6 MB)
"Stand there and don’t move until I tell you!"
(1.4 MB)
"There’s a big piece of cake left over from dinner"
(1.7 MB)
"Wait for me at the corner in front of the drugstore"
(1.6 MB)
"It’s no trouble at all" (1.1 MB)
"Hurry up!" (1.1 MB)
"The morning paper didn’t say anything about rain
this afternoon or tonight" (2.2 MB)
"The phone call’s for you" (1.1 MB)
"Where can I find a place to park?" (1.6 MB)
"I like those big red apples we always get in the fall" (1.8 MB)
"You'll get fat eating
candy" (1.5 MB)
"The show's over"
(1.2 MB)
"Why don’t they paint their walls some other color?"
(1.4 MB)
"What’s new?"
(0.9 MB)
"What are you hiding under your coat?" (1.3 MB)
"How come I should always be the one to go first?" (1.5 MB)
"I’ll take sugar and cream in my coffee" (1.6 MB)
"Wait just a minute!" (1.2 MB)
"Breakfast is ready" (1.1 MB)
"I don’t know what’s wrong with the car, but it won’t start" (1.6 MB)
"It sure takes a sharp knife to cut this meat" (1.5 MB)
"I haven’t read a newspaper since we bought a television set" (1.6 MB)
"Weeds are spoiling the yard" (1.1 MB)
"Call me a little later!" (1.2 MB)
"Do you have change for a five-dollar bill?" (1.4 MB)
"How are you?" (0.9 MB)
"I’d like some ice cream with my pie" (1.5 MB)
"I don’t think I’ll have any dessert" (1.2 MB)
http://www.mat.unb.br/~lucero/facial/qr2.html
December 1st, 2007