Code
library(readxl)
library(plyr)
library(tidyverse)
library(tidytext)
library(quanteda)
library(stm)
::opts_chunk$set(echo = TRUE) knitr
Claire Battaglia
November 13, 2022
In my last post I applied dictionary methods to my corpus: responses to the open-text survey question “What changes would you like to see for Missoula’s food system?” I used both the NRC and General Inquirer dictionaries to conduct a sentiment analysis but ultimately decided that this was not an appropriate analysis for my corpus. This is primarily because the survey question doesn’t ask specifically about respondents’ feelings about anything, meaning that a typical valid response doesn’t contain either positive or negative sentiment.
I plan to create my own dictionary at some point but for this post I will be attempting to analyze my corpus using Structural Topic Modeling (STM). This method of analysis will allow me to understand both the prevalence of topics across my corpus and the content (i.e. words used to talk about) those topics. Importantly, STM will allow me to analyze the responses alongside some covariates of interest. The two that I am particularly interested in are ZIP Code and annual household income. I expect that at least the prevalence of topics will vary by these two covariates, if not the content. Keeping the long term goal of this analysis in mind, it makes a tremendous difference if respondents recommending a particular change to the food system are concentrated in a single ZIP Code or income bracket or distributed across the city/over all income brackets.
I created a DFM in a previous post but I’ll create a new one here because the one I previously created doesn’t contain the covariates I’m interested in.
Warning: '...' should not be used for tokens() arguments; use 'tokens()' first.
Warning: 'remove' is deprecated; use dfm_remove() instead
[1] 215 1146
It contains 215 rows (the responses, called documents here) and 1,146 columns (all the words that appear in the corpus).
Now I’ll take a quick look at the two covariates I am interested in: ZIP Code and annual household income.
59701 59801 59802 59803 59804 59808 59821 59823 59825 59826 59833 59846 59847
1 85 62 20 9 15 1 5 4 1 2 1 5
59860 59864 59868 59908
1 1 1 1
Between $100,000 and $249,999 Between $25,000 and $34,999
55 21
Between $35,000 and $49,999 Between $50,000 and $99,999
37 66
Over $250,000 Under $25,000
8 28
Warning in dfm2stm(x, docvars, omit_empty = TRUE): Dropped empty document(s):
text96
A topic model with 5 topics, 214 documents and a 1146 word dictionary.
Topic 1 Top Words:
Highest Prob: affordable, local, land, less, gardens, access, farm
FREX: less, meals, affordable, land, communities, county, dairy
Lift: boulevards, less, meals, 2-5x, accessed, acquisition, additional
Score: affordable, land, use, affordability, less, boulevards, raised
Topic 2 Top Words:
Highest Prob: local, farmers, market, support, ag, produce, winter
FREX: ag, winter, enough, farmer's, living, market, costs
Lift: -or, +, 1, 1,000, 10, ability, activities
Score: winter, costs, ag, among, evidence-based, feeding, market
Topic 3 Top Words:
Highest Prob: food, locally, like, local, see, healthy, can
FREX: grown, produced, locally, economically, food, healthy, year
Lift: cans, grown, resource, allowing, attend, average, barriers
Score: locally, grown, poor, produced, food, can, resource
Topic 4 Top Words:
Highest Prob: food, see, school, like, land, local, sustainable
FREX: focus, also, space, school, development, help, preserve
Lift: $, 5-, abundant, alleviate, allowed, along, also
Score: csa, lose, pandemic, space, livestock, ranchers, urban
Topic 5 Top Words:
Highest Prob: local, foods, produce, stores, farmers, markets, community
FREX: afford, restaurants, away, buying, composting, even, many
Lift: #11, adults, alone, appealing, applaud, apple, apples
Score: composting, produce, afford, really, buying, shares, balance
A few things to note:
stm()
function automatically drops empty documents. Because I removed all rows that contained NA values from my tidy dataset, however, I am not sure why Text 96 is being considered “empty.” I have a feeling this is going to cause problems later on.stm()
function from the stm
package because I am ultimately building a STM and not a CTM.Next I’ll use the labelTopics()
function to take a look at the words that are associated with each of the five topics that have been revealed.
Topic 1 Top Words:
Highest Prob: affordable, local, land, less, gardens, access, farm
FREX: less, meals, affordable, land, communities, county, dairy
Lift: boulevards, less, meals, 2-5x, accessed, acquisition, additional
Score: affordable, land, use, affordability, less, boulevards, raised
Topic 2 Top Words:
Highest Prob: local, farmers, market, support, ag, produce, winter
FREX: ag, winter, enough, farmer's, living, market, costs
Lift: -or, +, 1, 1,000, 10, ability, activities
Score: winter, costs, ag, among, evidence-based, feeding, market
Topic 3 Top Words:
Highest Prob: food, locally, like, local, see, healthy, can
FREX: grown, produced, locally, economically, food, healthy, year
Lift: cans, grown, resource, allowing, attend, average, barriers
Score: locally, grown, poor, produced, food, can, resource
Topic 4 Top Words:
Highest Prob: food, see, school, like, land, local, sustainable
FREX: focus, also, space, school, development, help, preserve
Lift: $, 5-, abundant, alleviate, allowed, along, also
Score: csa, lose, pandemic, space, livestock, ranchers, urban
Topic 5 Top Words:
Highest Prob: local, foods, produce, stores, farmers, markets, community
FREX: afford, restaurants, away, buying, composting, even, many
Lift: #11, adults, alone, appealing, applaud, apple, apples
Score: composting, produce, afford, really, buying, shares, balance
According to the package documentation:
Highest Probability are the words with the highest probability of association with that topic .
FREX weights words by their overall frequency and how exclusive they are to that topic.
Lift weights words by dividing by their frequency in other topics.
Score divides the log frequency of the word in the topic by the log frequency of the word in other topics.
Next the findThoughts()
function will allow me to see an example document that is highly associated with each of the five topics.
Error in findThoughts(ctm_change, texts = CFA_tidy$change, topics = c(1:5), : Number of provided texts and number of documents modeled do not match
I think that this error is occurring because Text 96 was removed and so now there are 215 rows in my dataset but only 214 texts. As mentioned previously, I am not sure why Text 96 was removed so I’ll take a look at it now and see if I can figure it out.
# A tibble: 1 × 5
id zip age income change
<chr> <chr> <dbl> <chr> <chr>
1 12981031063 59802 63 Between $50,000 and $99,999 ?
I see the problem. That row was not removed when I removed rows with NA values but the change cell contains no information in my DFM because I removed punctuation. I’ll remove that row and see if that fixes the problem.
# A tibble: 214 × 5
id zip age income change
<chr> <chr> <dbl> <chr> <chr>
1 12978141302 59823 72 Under $25,000 "More concentration on…
2 12991074702 59802 29 Between $50,000 and $99,999 "I'd like to see more …
3 12985165265 59801 60 Between $50,000 and $99,999 "Factual, evidence-bas…
4 12978197761 59801 61 Between $50,000 and $99,999 "Whatever it takes to …
5 13020467460 59801 83 Between $35,000 and $49,999 "More competitive pric…
6 12972697121 59802 56 Between $100,000 and $249,999 "More education about …
7 12977827881 59803 65 Between $50,000 and $99,999 "Greater focus on loca…
8 13003104091 59808 29 Between $35,000 and $49,999 "I applaud good food s…
9 12981080680 59801 54 Between $100,000 and $249,999 "More policies and pro…
10 12977865121 59802 27 Under $25,000 "An expansion of more …
# … with 204 more rows
Everything looks good to me so now I’ll create a new DFM from my new tidy dataset.
Warning: '...' should not be used for tokens() arguments; use 'tokens()' first.
Warning: 'remove' is deprecated; use dfm_remove() instead
[1] 214 1146
A topic model with 5 topics, 214 documents and a 1146 word dictionary.
Topic 1 Top Words:
Highest Prob: affordable, local, land, less, gardens, access, farm
FREX: less, meals, affordable, land, communities, county, dairy
Lift: boulevards, less, meals, 2-5x, accessed, acquisition, additional
Score: affordable, land, use, affordability, less, boulevards, raised
Topic 2 Top Words:
Highest Prob: local, farmers, market, support, ag, produce, winter
FREX: ag, winter, enough, farmer's, living, market, costs
Lift: -or, +, 1, 1,000, 10, ability, activities
Score: winter, costs, ag, among, evidence-based, feeding, market
Topic 3 Top Words:
Highest Prob: food, locally, like, local, see, healthy, can
FREX: grown, produced, locally, economically, food, healthy, year
Lift: cans, grown, resource, allowing, attend, average, barriers
Score: locally, grown, poor, produced, food, can, resource
Topic 4 Top Words:
Highest Prob: food, see, school, like, land, local, sustainable
FREX: focus, also, space, school, development, help, preserve
Lift: $, 5-, abundant, alleviate, allowed, along, also
Score: csa, lose, pandemic, space, livestock, ranchers, urban
Topic 5 Top Words:
Highest Prob: local, foods, produce, stores, farmers, markets, community
FREX: afford, restaurants, away, buying, composting, even, many
Lift: #11, adults, alone, appealing, applaud, apple, apples
Score: composting, produce, afford, really, buying, shares, balance
Topic 1 Top Words:
Highest Prob: affordable, local, land, less, gardens, access, farm
FREX: less, meals, affordable, land, communities, county, dairy
Lift: boulevards, less, meals, 2-5x, accessed, acquisition, additional
Score: affordable, land, use, affordability, less, boulevards, raised
Topic 2 Top Words:
Highest Prob: local, farmers, market, support, ag, produce, winter
FREX: ag, winter, enough, farmer's, living, market, costs
Lift: -or, +, 1, 1,000, 10, ability, activities
Score: winter, costs, ag, among, evidence-based, feeding, market
Topic 3 Top Words:
Highest Prob: food, locally, like, local, see, healthy, can
FREX: grown, produced, locally, economically, food, healthy, year
Lift: cans, grown, resource, allowing, attend, average, barriers
Score: locally, grown, poor, produced, food, can, resource
Topic 4 Top Words:
Highest Prob: food, see, school, like, land, local, sustainable
FREX: focus, also, space, school, development, help, preserve
Lift: $, 5-, abundant, alleviate, allowed, along, also
Score: csa, lose, pandemic, space, livestock, ranchers, urban
Topic 5 Top Words:
Highest Prob: local, foods, produce, stores, farmers, markets, community
FREX: afford, restaurants, away, buying, composting, even, many
Lift: #11, adults, alone, appealing, applaud, apple, apples
Score: composting, produce, afford, really, buying, shares, balance
Topic 1:
Community gardens should be a part of all housing developments, the city is stacking people on top of people with no regard for consequences including burying prime agricultural land under a sea of concrete.
Topic 2:
An expansion of more produce for low income families in aid packages. The boost in farmer’s market coupons and extra produce with wic during summer is amazing but in the winter it’s just back to way too much cereal and grains which isn’t okay. One of our biggest issues in the winter is finding funds for a variety of fresh foods since everything becomes so much more expensive. I’m not vying for pineapples in January or anything but maybe an indoor farmer’s market to get greens and greenhouse crops from local farmers. That could extend the farmer’s season and provide more fresh options to missoulians that haven’t traveled 1,000+ miles
Topic 3:
I’d like to see I ncreased opportunities for preservation of irrigable lands and increased local food options (although Neva and other folks have done a good job trying). Water is a limited resource, so preservation of that resource (and valuable soils) will largely be what determines our food security into the future.
Topic 4:
The urban sprawl and development of prime farm land is a big deal. Once a subdivision is built, there is no going back. It would also be nice if urban farms could legally raise livestock including more than 6 chickens, pigs, cows and goats. Urban farms would be more effficient systems if they were allowed to integrate livestock into their farming systems. For example, grazing animals to keep grass and weeds down, pigs to feed farm/food waste too, and all of the manure to compost and use for fertilizer.
Topic 5:
More community garden plots in underserved areas with regular on site support to teach families (or even just kids) to plant, grow and harvest. Sometimes kids want a better life than their parents are willing or able to provide.
Yes! That seems to have resolved the problem. Now I’ll use the second DFM to build a STM.
Beginning Spectral Initialization
Calculating the gram matrix...
Finding anchor words...
.....
Recovering initialization...
...........
Initialization complete.
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 1 (approx. per word bound = -6.398)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 2 (approx. per word bound = -6.250, relative change = 2.321e-02)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 3 (approx. per word bound = -6.202, relative change = 7.664e-03)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 4 (approx. per word bound = -6.182, relative change = 3.212e-03)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 5 (approx. per word bound = -6.172, relative change = 1.653e-03)
Topic 1: land, affordable, access, gardens, less
Topic 2: farmers, local, support, can, greater
Topic 3: food, like, healthy, available, farmland
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: see, community, produce, options, foods
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 6 (approx. per word bound = -6.165, relative change = 1.027e-03)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 7 (approx. per word bound = -6.160, relative change = 7.865e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 8 (approx. per word bound = -6.156, relative change = 7.148e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 9 (approx. per word bound = -6.152, relative change = 6.832e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 10 (approx. per word bound = -6.148, relative change = 5.817e-04)
Topic 1: land, affordable, access, gardens, less
Topic 2: farmers, local, support, can, market
Topic 3: food, like, healthy, locally, available
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: see, community, produce, foods, options
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 11 (approx. per word bound = -6.146, relative change = 4.422e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 12 (approx. per word bound = -6.143, relative change = 3.470e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 13 (approx. per word bound = -6.142, relative change = 2.922e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 14 (approx. per word bound = -6.140, relative change = 2.559e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 15 (approx. per word bound = -6.139, relative change = 2.471e-04)
Topic 1: land, affordable, access, gardens, less
Topic 2: farmers, local, support, can, market
Topic 3: food, like, healthy, locally, available
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: see, community, produce, foods, options
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 16 (approx. per word bound = -6.137, relative change = 2.756e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 17 (approx. per word bound = -6.135, relative change = 3.130e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 18 (approx. per word bound = -6.133, relative change = 3.081e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 19 (approx. per word bound = -6.131, relative change = 2.784e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 20 (approx. per word bound = -6.130, relative change = 2.587e-04)
Topic 1: land, affordable, access, gardens, less
Topic 2: farmers, local, support, can, market
Topic 3: food, like, healthy, locally, available
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: see, community, produce, foods, options
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 21 (approx. per word bound = -6.128, relative change = 2.594e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 22 (approx. per word bound = -6.126, relative change = 2.691e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 23 (approx. per word bound = -6.125, relative change = 2.793e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 24 (approx. per word bound = -6.123, relative change = 3.079e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 25 (approx. per word bound = -6.121, relative change = 3.509e-04)
Topic 1: land, affordable, access, gardens, less
Topic 2: farmers, local, support, can, market
Topic 3: food, like, healthy, locally, available
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: see, community, produce, foods, options
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 26 (approx. per word bound = -6.119, relative change = 3.594e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 27 (approx. per word bound = -6.117, relative change = 3.240e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 28 (approx. per word bound = -6.115, relative change = 3.260e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 29 (approx. per word bound = -6.112, relative change = 3.825e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 30 (approx. per word bound = -6.110, relative change = 4.397e-04)
Topic 1: land, affordable, access, gardens, less
Topic 2: farmers, local, support, can, market
Topic 3: food, like, healthy, locally, available
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: see, community, local, produce, foods
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 31 (approx. per word bound = -6.107, relative change = 4.275e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 32 (approx. per word bound = -6.105, relative change = 3.947e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 33 (approx. per word bound = -6.102, relative change = 3.707e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 34 (approx. per word bound = -6.100, relative change = 3.529e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 35 (approx. per word bound = -6.098, relative change = 3.726e-04)
Topic 1: land, affordable, access, gardens, less
Topic 2: farmers, local, support, can, market
Topic 3: food, like, locally, healthy, available
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: see, local, community, foods, produce
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 36 (approx. per word bound = -6.095, relative change = 4.394e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 37 (approx. per word bound = -6.092, relative change = 4.966e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 38 (approx. per word bound = -6.089, relative change = 4.751e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 39 (approx. per word bound = -6.087, relative change = 4.320e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 40 (approx. per word bound = -6.084, relative change = 4.320e-04)
Topic 1: land, affordable, access, gardens, less
Topic 2: farmers, local, support, can, market
Topic 3: food, like, locally, healthy, available
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: local, see, community, foods, options
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 41 (approx. per word bound = -6.081, relative change = 5.267e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 42 (approx. per word bound = -6.077, relative change = 5.872e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 43 (approx. per word bound = -6.074, relative change = 4.869e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 44 (approx. per word bound = -6.071, relative change = 4.671e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 45 (approx. per word bound = -6.068, relative change = 5.378e-04)
Topic 1: land, affordable, access, gardens, less
Topic 2: farmers, local, support, can, market
Topic 3: food, like, locally, healthy, available
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: local, see, community, foods, options
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 46 (approx. per word bound = -6.065, relative change = 5.821e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 47 (approx. per word bound = -6.062, relative change = 4.025e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 48 (approx. per word bound = -6.060, relative change = 3.454e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 49 (approx. per word bound = -6.058, relative change = 3.431e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 50 (approx. per word bound = -6.056, relative change = 2.968e-04)
Topic 1: land, affordable, access, gardens, less
Topic 2: farmers, local, support, can, market
Topic 3: food, like, locally, healthy, available
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: local, see, community, foods, options
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 51 (approx. per word bound = -6.054, relative change = 3.024e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 52 (approx. per word bound = -6.052, relative change = 3.334e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 53 (approx. per word bound = -6.050, relative change = 3.357e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 54 (approx. per word bound = -6.048, relative change = 3.172e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 55 (approx. per word bound = -6.046, relative change = 3.722e-04)
Topic 1: land, affordable, access, gardens, less
Topic 2: farmers, local, support, can, market
Topic 3: food, like, locally, healthy, available
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: local, see, community, foods, options
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 56 (approx. per word bound = -6.043, relative change = 5.188e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 57 (approx. per word bound = -6.039, relative change = 6.634e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 58 (approx. per word bound = -6.035, relative change = 6.552e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 59 (approx. per word bound = -6.032, relative change = 5.808e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 60 (approx. per word bound = -6.028, relative change = 5.253e-04)
Topic 1: land, affordable, gardens, access, less
Topic 2: farmers, local, support, can, market
Topic 3: food, like, locally, healthy, available
Topic 4: local, farm, sustainable, missoula, stores
Topic 5: local, see, community, foods, options
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 61 (approx. per word bound = -6.025, relative change = 4.958e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 62 (approx. per word bound = -6.022, relative change = 5.073e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 63 (approx. per word bound = -6.019, relative change = 5.470e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 64 (approx. per word bound = -6.015, relative change = 6.087e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 65 (approx. per word bound = -6.012, relative change = 6.376e-04)
Topic 1: land, affordable, gardens, less, use
Topic 2: farmers, local, support, market, good
Topic 3: food, like, locally, healthy, available
Topic 4: local, farm, sustainable, missoula, education
Topic 5: local, see, foods, options, community
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 66 (approx. per word bound = -6.008, relative change = 5.787e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 67 (approx. per word bound = -6.005, relative change = 5.584e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 68 (approx. per word bound = -6.001, relative change = 5.969e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 69 (approx. per word bound = -5.999, relative change = 4.284e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 70 (approx. per word bound = -5.997, relative change = 3.320e-04)
Topic 1: land, affordable, gardens, less, use
Topic 2: farmers, local, support, community, market
Topic 3: food, like, locally, healthy, available
Topic 4: local, farm, sustainable, missoula, education
Topic 5: local, see, foods, options, produce
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 71 (approx. per word bound = -5.995, relative change = 3.242e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 72 (approx. per word bound = -5.993, relative change = 3.386e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 73 (approx. per word bound = -5.990, relative change = 4.082e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 74 (approx. per word bound = -5.987, relative change = 5.037e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 75 (approx. per word bound = -5.984, relative change = 4.910e-04)
Topic 1: land, affordable, gardens, less, use
Topic 2: farmers, local, community, support, market
Topic 3: food, like, locally, healthy, available
Topic 4: farm, local, sustainable, missoula, see
Topic 5: local, foods, options, see, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 76 (approx. per word bound = -5.982, relative change = 4.227e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 77 (approx. per word bound = -5.979, relative change = 3.684e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 78 (approx. per word bound = -5.977, relative change = 3.353e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 79 (approx. per word bound = -5.975, relative change = 3.315e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 80 (approx. per word bound = -5.974, relative change = 3.226e-04)
Topic 1: land, affordable, gardens, less, use
Topic 2: farmers, local, community, support, market
Topic 3: food, like, locally, healthy, grown
Topic 4: see, farm, local, sustainable, missoula
Topic 5: local, foods, options, grocery, produce
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 81 (approx. per word bound = -5.971, relative change = 3.434e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 82 (approx. per word bound = -5.969, relative change = 3.955e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 83 (approx. per word bound = -5.966, relative change = 4.873e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 84 (approx. per word bound = -5.963, relative change = 5.699e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 85 (approx. per word bound = -5.959, relative change = 5.858e-04)
Topic 1: land, affordable, gardens, less, use
Topic 2: farmers, local, support, community, market
Topic 3: food, like, locally, healthy, grown
Topic 4: see, farm, sustainable, local, missoula
Topic 5: local, foods, options, grocery, produce
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 86 (approx. per word bound = -5.956, relative change = 5.787e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 87 (approx. per word bound = -5.953, relative change = 5.368e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 88 (approx. per word bound = -5.950, relative change = 5.085e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 89 (approx. per word bound = -5.946, relative change = 5.606e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 90 (approx. per word bound = -5.943, relative change = 6.353e-04)
Topic 1: land, affordable, gardens, less, use
Topic 2: farmers, local, support, market, community
Topic 3: food, like, locally, healthy, grown
Topic 4: see, farm, sustainable, local, missoula
Topic 5: local, foods, options, grocery, stores
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 91 (approx. per word bound = -5.939, relative change = 5.806e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 92 (approx. per word bound = -5.936, relative change = 5.362e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 93 (approx. per word bound = -5.933, relative change = 4.770e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 94 (approx. per word bound = -5.931, relative change = 4.080e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 95 (approx. per word bound = -5.928, relative change = 3.750e-04)
Topic 1: land, affordable, gardens, less, agricultural
Topic 2: local, farmers, support, market, fresh
Topic 3: food, like, locally, healthy, grown
Topic 4: see, sustainable, farm, local, missoula
Topic 5: local, foods, options, grocery, stores
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 96 (approx. per word bound = -5.926, relative change = 4.124e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 97 (approx. per word bound = -5.924, relative change = 4.138e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 98 (approx. per word bound = -5.921, relative change = 4.066e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 99 (approx. per word bound = -5.919, relative change = 3.831e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 100 (approx. per word bound = -5.917, relative change = 3.747e-04)
Topic 1: land, affordable, gardens, less, use
Topic 2: local, farmers, support, market, fresh
Topic 3: food, like, locally, healthy, grown
Topic 4: see, sustainable, farm, local, missoula
Topic 5: local, options, foods, grocery, stores
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 101 (approx. per word bound = -5.915, relative change = 3.494e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 102 (approx. per word bound = -5.913, relative change = 2.953e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 103 (approx. per word bound = -5.911, relative change = 2.463e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 104 (approx. per word bound = -5.910, relative change = 2.248e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 105 (approx. per word bound = -5.909, relative change = 2.383e-04)
Topic 1: land, affordable, gardens, less, use
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, healthy, grown
Topic 4: see, sustainable, farm, local, school
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 106 (approx. per word bound = -5.907, relative change = 2.579e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 107 (approx. per word bound = -5.906, relative change = 2.614e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 108 (approx. per word bound = -5.904, relative change = 2.279e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 109 (approx. per word bound = -5.903, relative change = 1.897e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 110 (approx. per word bound = -5.902, relative change = 1.750e-04)
Topic 1: land, affordable, gardens, less, use
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, healthy, see
Topic 4: see, sustainable, farm, local, school
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 111 (approx. per word bound = -5.901, relative change = 1.780e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 112 (approx. per word bound = -5.900, relative change = 2.055e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 113 (approx. per word bound = -5.898, relative change = 2.446e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 114 (approx. per word bound = -5.897, relative change = 2.639e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 115 (approx. per word bound = -5.895, relative change = 2.796e-04)
Topic 1: land, affordable, gardens, less, use
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, healthy, see
Topic 4: sustainable, farm, see, local, school
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 116 (approx. per word bound = -5.894, relative change = 2.738e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 117 (approx. per word bound = -5.892, relative change = 2.161e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 118 (approx. per word bound = -5.891, relative change = 1.812e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 119 (approx. per word bound = -5.890, relative change = 1.784e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 120 (approx. per word bound = -5.889, relative change = 1.584e-04)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, local, see, farm, school
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 121 (approx. per word bound = -5.888, relative change = 1.270e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 122 (approx. per word bound = -5.888, relative change = 1.066e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 123 (approx. per word bound = -5.887, relative change = 8.903e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 124 (approx. per word bound = -5.887, relative change = 8.058e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 125 (approx. per word bound = -5.886, relative change = 8.432e-05)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, local, farm, see, school
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 126 (approx. per word bound = -5.886, relative change = 9.201e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 127 (approx. per word bound = -5.885, relative change = 9.095e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 128 (approx. per word bound = -5.885, relative change = 8.762e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 129 (approx. per word bound = -5.884, relative change = 9.963e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 130 (approx. per word bound = -5.883, relative change = 1.155e-04)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, local, farm, see, school
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 131 (approx. per word bound = -5.883, relative change = 1.255e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 132 (approx. per word bound = -5.882, relative change = 1.531e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 133 (approx. per word bound = -5.881, relative change = 2.066e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 134 (approx. per word bound = -5.879, relative change = 2.520e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 135 (approx. per word bound = -5.878, relative change = 2.635e-04)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, local, see, farm, school
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 136 (approx. per word bound = -5.876, relative change = 2.852e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 137 (approx. per word bound = -5.874, relative change = 2.993e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 138 (approx. per word bound = -5.873, relative change = 2.657e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 139 (approx. per word bound = -5.871, relative change = 2.136e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 140 (approx. per word bound = -5.870, relative change = 1.809e-04)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, see, local, school, farm
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 141 (approx. per word bound = -5.869, relative change = 1.843e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 142 (approx. per word bound = -5.868, relative change = 2.126e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 143 (approx. per word bound = -5.867, relative change = 2.206e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 144 (approx. per word bound = -5.865, relative change = 2.248e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 145 (approx. per word bound = -5.864, relative change = 2.827e-04)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, see, school, local, farm
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 146 (approx. per word bound = -5.862, relative change = 3.053e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 147 (approx. per word bound = -5.861, relative change = 1.899e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 148 (approx. per word bound = -5.860, relative change = 1.260e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 149 (approx. per word bound = -5.859, relative change = 1.322e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 150 (approx. per word bound = -5.859, relative change = 1.189e-04)
Topic 1: land, affordable, community, gardens, less
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, healthy, see
Topic 4: sustainable, see, local, school, farm
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 151 (approx. per word bound = -5.858, relative change = 8.199e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 152 (approx. per word bound = -5.858, relative change = 5.742e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 153 (approx. per word bound = -5.857, relative change = 5.132e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 154 (approx. per word bound = -5.857, relative change = 5.407e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 155 (approx. per word bound = -5.857, relative change = 6.077e-05)
Topic 1: land, affordable, community, gardens, less
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, healthy, see
Topic 4: sustainable, see, local, school, farm
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 156 (approx. per word bound = -5.856, relative change = 7.027e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 157 (approx. per word bound = -5.856, relative change = 8.719e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 158 (approx. per word bound = -5.855, relative change = 1.010e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 159 (approx. per word bound = -5.855, relative change = 8.602e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 160 (approx. per word bound = -5.854, relative change = 8.787e-05)
Topic 1: land, affordable, community, gardens, less
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, healthy, see
Topic 4: sustainable, see, local, school, farm
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 161 (approx. per word bound = -5.854, relative change = 8.793e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 162 (approx. per word bound = -5.853, relative change = 8.845e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 163 (approx. per word bound = -5.853, relative change = 1.066e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 164 (approx. per word bound = -5.852, relative change = 1.061e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 165 (approx. per word bound = -5.851, relative change = 8.141e-05)
Topic 1: land, affordable, community, gardens, less
Topic 2: local, farmers, market, support, fresh
Topic 3: food, like, locally, healthy, see
Topic 4: sustainable, see, local, school, farm
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 166 (approx. per word bound = -5.851, relative change = 6.358e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 167 (approx. per word bound = -5.851, relative change = 5.734e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 168 (approx. per word bound = -5.850, relative change = 5.347e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 169 (approx. per word bound = -5.850, relative change = 5.439e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 170 (approx. per word bound = -5.850, relative change = 5.610e-05)
Topic 1: land, affordable, community, gardens, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, like, locally, healthy, see
Topic 4: sustainable, see, local, school, farm
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 171 (approx. per word bound = -5.849, relative change = 5.923e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 172 (approx. per word bound = -5.849, relative change = 6.217e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 173 (approx. per word bound = -5.849, relative change = 6.467e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 174 (approx. per word bound = -5.848, relative change = 6.580e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 175 (approx. per word bound = -5.848, relative change = 6.858e-05)
Topic 1: land, affordable, community, gardens, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, see, local, school, farm
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 176 (approx. per word bound = -5.847, relative change = 7.786e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 177 (approx. per word bound = -5.847, relative change = 8.521e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 178 (approx. per word bound = -5.846, relative change = 8.385e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 179 (approx. per word bound = -5.846, relative change = 8.154e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 180 (approx. per word bound = -5.846, relative change = 8.008e-05)
Topic 1: land, affordable, community, gardens, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, see, local, school, farm
Topic 5: local, foods, options, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 181 (approx. per word bound = -5.845, relative change = 7.668e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 182 (approx. per word bound = -5.845, relative change = 7.475e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 183 (approx. per word bound = -5.844, relative change = 7.932e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 184 (approx. per word bound = -5.844, relative change = 9.537e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 185 (approx. per word bound = -5.843, relative change = 1.156e-04)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, see, local, school, like
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 186 (approx. per word bound = -5.842, relative change = 1.123e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 187 (approx. per word bound = -5.842, relative change = 1.074e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 188 (approx. per word bound = -5.841, relative change = 1.205e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 189 (approx. per word bound = -5.840, relative change = 1.345e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 190 (approx. per word bound = -5.839, relative change = 1.283e-04)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, see, school, local, like
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 191 (approx. per word bound = -5.839, relative change = 1.162e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 192 (approx. per word bound = -5.838, relative change = 1.047e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 193 (approx. per word bound = -5.838, relative change = 9.846e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 194 (approx. per word bound = -5.837, relative change = 9.920e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 195 (approx. per word bound = -5.836, relative change = 1.016e-04)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, see, school, local, like
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 196 (approx. per word bound = -5.836, relative change = 9.748e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 197 (approx. per word bound = -5.835, relative change = 9.045e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 198 (approx. per word bound = -5.835, relative change = 1.368e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 199 (approx. per word bound = -5.832, relative change = 3.683e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 200 (approx. per word bound = -5.831, relative change = 2.454e-04)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, see, school, local, like
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 201 (approx. per word bound = -5.831, relative change = 6.402e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 202 (approx. per word bound = -5.830, relative change = 5.569e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 203 (approx. per word bound = -5.830, relative change = 6.317e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 204 (approx. per word bound = -5.829, relative change = 7.686e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 205 (approx. per word bound = -5.829, relative change = 9.054e-05)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, like, locally, see, healthy
Topic 4: sustainable, see, school, like, local
Topic 5: local, options, foods, stores, grocery
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 206 (approx. per word bound = -5.828, relative change = 1.052e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 207 (approx. per word bound = -5.828, relative change = 1.290e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 208 (approx. per word bound = -5.827, relative change = 1.622e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 209 (approx. per word bound = -5.825, relative change = 1.866e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 210 (approx. per word bound = -5.824, relative change = 1.791e-04)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: sustainable, see, school, like, local
Topic 5: local, options, foods, stores, produce
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 211 (approx. per word bound = -5.824, relative change = 1.434e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 212 (approx. per word bound = -5.823, relative change = 1.080e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 213 (approx. per word bound = -5.823, relative change = 8.101e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 214 (approx. per word bound = -5.822, relative change = 6.048e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 215 (approx. per word bound = -5.822, relative change = 4.626e-05)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, see, sustainable, school, like
Topic 5: local, options, foods, stores, produce
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 216 (approx. per word bound = -5.822, relative change = 3.734e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 217 (approx. per word bound = -5.821, relative change = 3.090e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 218 (approx. per word bound = -5.821, relative change = 2.577e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 219 (approx. per word bound = -5.821, relative change = 2.060e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 220 (approx. per word bound = -5.821, relative change = 1.813e-05)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, see, sustainable, school, like
Topic 5: local, options, foods, stores, produce
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 221 (approx. per word bound = -5.821, relative change = 1.593e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 222 (approx. per word bound = -5.821, relative change = 1.827e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 223 (approx. per word bound = -5.821, relative change = 2.477e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 224 (approx. per word bound = -5.821, relative change = 3.736e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 225 (approx. per word bound = -5.820, relative change = 5.417e-05)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, see, sustainable, school, like
Topic 5: local, options, foods, stores, produce
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 226 (approx. per word bound = -5.820, relative change = 7.089e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 227 (approx. per word bound = -5.819, relative change = 7.482e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 228 (approx. per word bound = -5.819, relative change = 6.728e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 229 (approx. per word bound = -5.819, relative change = 5.577e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 230 (approx. per word bound = -5.818, relative change = 5.427e-05)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, see, sustainable, school, like
Topic 5: local, options, foods, produce, stores
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 231 (approx. per word bound = -5.818, relative change = 6.374e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 232 (approx. per word bound = -5.818, relative change = 7.807e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 233 (approx. per word bound = -5.817, relative change = 9.332e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 234 (approx. per word bound = -5.816, relative change = 1.185e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 235 (approx. per word bound = -5.815, relative change = 1.591e-04)
Topic 1: land, affordable, gardens, community, less
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, see, sustainable, school, like
Topic 5: local, options, foods, produce, stores
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 236 (approx. per word bound = -5.814, relative change = 2.012e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 237 (approx. per word bound = -5.813, relative change = 2.291e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 238 (approx. per word bound = -5.811, relative change = 2.399e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 239 (approx. per word bound = -5.810, relative change = 2.031e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 240 (approx. per word bound = -5.809, relative change = 1.480e-04)
Topic 1: land, affordable, local, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, sustainable, see, school, like
Topic 5: local, foods, options, produce, stores
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 241 (approx. per word bound = -5.809, relative change = 1.115e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 242 (approx. per word bound = -5.808, relative change = 9.122e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 243 (approx. per word bound = -5.808, relative change = 8.486e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 244 (approx. per word bound = -5.807, relative change = 9.119e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 245 (approx. per word bound = -5.807, relative change = 9.245e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, sustainable, see, school, like
Topic 5: local, foods, options, produce, stores
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 246 (approx. per word bound = -5.806, relative change = 8.117e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 247 (approx. per word bound = -5.806, relative change = 6.862e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 248 (approx. per word bound = -5.805, relative change = 6.613e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 249 (approx. per word bound = -5.805, relative change = 8.342e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 250 (approx. per word bound = -5.804, relative change = 1.142e-04)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, sustainable, see, school, like
Topic 5: local, foods, options, produce, stores
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 251 (approx. per word bound = -5.804, relative change = 1.063e-04)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 252 (approx. per word bound = -5.803, relative change = 7.167e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 253 (approx. per word bound = -5.803, relative change = 7.164e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 254 (approx. per word bound = -5.802, relative change = 7.973e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 255 (approx. per word bound = -5.802, relative change = 8.326e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, sustainable, see, school, like
Topic 5: local, foods, produce, stores, options
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 256 (approx. per word bound = -5.801, relative change = 8.798e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 257 (approx. per word bound = -5.801, relative change = 9.482e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 258 (approx. per word bound = -5.800, relative change = 8.003e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 259 (approx. per word bound = -5.800, relative change = 6.215e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 260 (approx. per word bound = -5.800, relative change = 6.098e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, see, sustainable, school, like
Topic 5: local, foods, produce, stores, farmers
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 261 (approx. per word bound = -5.799, relative change = 7.173e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 262 (approx. per word bound = -5.799, relative change = 8.513e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 263 (approx. per word bound = -5.798, relative change = 8.433e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 264 (approx. per word bound = -5.798, relative change = 7.737e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 265 (approx. per word bound = -5.797, relative change = 7.002e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, farmers
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 266 (approx. per word bound = -5.797, relative change = 6.682e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 267 (approx. per word bound = -5.797, relative change = 6.289e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 268 (approx. per word bound = -5.796, relative change = 6.042e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 269 (approx. per word bound = -5.796, relative change = 6.077e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 270 (approx. per word bound = -5.796, relative change = 5.963e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, healthy, see
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, farmers
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 271 (approx. per word bound = -5.795, relative change = 5.796e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 272 (approx. per word bound = -5.795, relative change = 5.250e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 273 (approx. per word bound = -5.795, relative change = 4.113e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 274 (approx. per word bound = -5.795, relative change = 3.074e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 275 (approx. per word bound = -5.794, relative change = 2.242e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, healthy
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, farmers
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 276 (approx. per word bound = -5.794, relative change = 1.955e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 277 (approx. per word bound = -5.794, relative change = 1.871e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 278 (approx. per word bound = -5.794, relative change = 2.293e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 279 (approx. per word bound = -5.794, relative change = 2.656e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 280 (approx. per word bound = -5.794, relative change = 3.293e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, healthy
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, farmers
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 281 (approx. per word bound = -5.794, relative change = 3.701e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 282 (approx. per word bound = -5.793, relative change = 4.061e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 283 (approx. per word bound = -5.793, relative change = 4.190e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 284 (approx. per word bound = -5.793, relative change = 4.021e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 285 (approx. per word bound = -5.793, relative change = 3.348e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, healthy
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, farmers
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 286 (approx. per word bound = -5.792, relative change = 2.568e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 287 (approx. per word bound = -5.792, relative change = 2.197e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 288 (approx. per word bound = -5.792, relative change = 2.474e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 289 (approx. per word bound = -5.792, relative change = 3.090e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 290 (approx. per word bound = -5.792, relative change = 3.925e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, healthy
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, farmers
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 291 (approx. per word bound = -5.791, relative change = 4.891e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 292 (approx. per word bound = -5.791, relative change = 5.725e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 293 (approx. per word bound = -5.791, relative change = 5.918e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 294 (approx. per word bound = -5.790, relative change = 5.722e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 295 (approx. per word bound = -5.790, relative change = 5.238e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, healthy
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, farmers
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 296 (approx. per word bound = -5.790, relative change = 5.622e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 297 (approx. per word bound = -5.790, relative change = 5.906e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 298 (approx. per word bound = -5.789, relative change = 4.874e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 299 (approx. per word bound = -5.789, relative change = 4.356e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 300 (approx. per word bound = -5.789, relative change = 4.721e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, healthy
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, farmers
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 301 (approx. per word bound = -5.788, relative change = 5.139e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 302 (approx. per word bound = -5.788, relative change = 5.714e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 303 (approx. per word bound = -5.788, relative change = 5.076e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 304 (approx. per word bound = -5.788, relative change = 4.150e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 305 (approx. per word bound = -5.787, relative change = 3.871e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, can
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, farmers
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 306 (approx. per word bound = -5.787, relative change = 3.941e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 307 (approx. per word bound = -5.787, relative change = 4.397e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 308 (approx. per word bound = -5.787, relative change = 5.037e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 309 (approx. per word bound = -5.786, relative change = 5.516e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 310 (approx. per word bound = -5.786, relative change = 5.572e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, local
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, markets
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 311 (approx. per word bound = -5.786, relative change = 5.669e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 312 (approx. per word bound = -5.785, relative change = 5.055e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 313 (approx. per word bound = -5.785, relative change = 3.813e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 314 (approx. per word bound = -5.785, relative change = 3.227e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 315 (approx. per word bound = -5.785, relative change = 4.058e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, local
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, markets
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 316 (approx. per word bound = -5.784, relative change = 8.984e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 317 (approx. per word bound = -5.784, relative change = 9.037e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 318 (approx. per word bound = -5.783, relative change = 5.704e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 319 (approx. per word bound = -5.783, relative change = 3.690e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 320 (approx. per word bound = -5.783, relative change = 3.306e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, local
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, markets
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 321 (approx. per word bound = -5.783, relative change = 4.649e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 322 (approx. per word bound = -5.782, relative change = 3.189e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 323 (approx. per word bound = -5.782, relative change = 1.795e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 324 (approx. per word bound = -5.782, relative change = 1.344e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 325 (approx. per word bound = -5.782, relative change = 1.234e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, local
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, markets
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 326 (approx. per word bound = -5.782, relative change = 1.167e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 327 (approx. per word bound = -5.782, relative change = 1.125e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 328 (approx. per word bound = -5.782, relative change = 1.169e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 329 (approx. per word bound = -5.782, relative change = 1.109e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 330 (approx. per word bound = -5.782, relative change = 1.241e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, local
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, markets
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 331 (approx. per word bound = -5.782, relative change = 1.313e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 332 (approx. per word bound = -5.782, relative change = 1.527e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 333 (approx. per word bound = -5.782, relative change = 1.759e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 334 (approx. per word bound = -5.781, relative change = 2.042e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 335 (approx. per word bound = -5.781, relative change = 2.411e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, local
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, markets
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 336 (approx. per word bound = -5.781, relative change = 2.802e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 337 (approx. per word bound = -5.781, relative change = 3.259e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 338 (approx. per word bound = -5.781, relative change = 3.561e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 339 (approx. per word bound = -5.781, relative change = 3.923e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 340 (approx. per word bound = -5.780, relative change = 4.435e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, local
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, markets
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 341 (approx. per word bound = -5.780, relative change = 5.070e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 342 (approx. per word bound = -5.780, relative change = 5.712e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 343 (approx. per word bound = -5.779, relative change = 6.445e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 344 (approx. per word bound = -5.779, relative change = 6.447e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 345 (approx. per word bound = -5.779, relative change = 5.145e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, local
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, markets
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 346 (approx. per word bound = -5.778, relative change = 4.267e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 347 (approx. per word bound = -5.778, relative change = 4.199e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 348 (approx. per word bound = -5.778, relative change = 4.607e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 349 (approx. per word bound = -5.778, relative change = 5.217e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 350 (approx. per word bound = -5.777, relative change = 5.495e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, local
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, produce, stores, food
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 351 (approx. per word bound = -5.777, relative change = 5.200e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 352 (approx. per word bound = -5.777, relative change = 4.680e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 353 (approx. per word bound = -5.776, relative change = 4.322e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 354 (approx. per word bound = -5.776, relative change = 3.692e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 355 (approx. per word bound = -5.776, relative change = 2.984e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, local
Topic 4: food, see, school, like, sustainable
Topic 5: local, foods, food, produce, stores
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 356 (approx. per word bound = -5.776, relative change = 2.228e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 357 (approx. per word bound = -5.776, relative change = 1.806e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 358 (approx. per word bound = -5.776, relative change = 1.819e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 359 (approx. per word bound = -5.776, relative change = 2.104e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 360 (approx. per word bound = -5.775, relative change = 2.454e-05)
Topic 1: land, local, affordable, gardens, community
Topic 2: local, farmers, market, support, ag
Topic 3: food, locally, like, see, local
Topic 4: food, see, school, like, sustainable
Topic 5: local, food, foods, produce, stores
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 361 (approx. per word bound = -5.775, relative change = 2.165e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Completing Iteration 362 (approx. per word bound = -5.775, relative change = 1.327e-05)
...........................................................................................................
Completed E-Step (0 seconds).
Completed M-Step.
Model Converged
Topic 1 Top Words:
Highest Prob: land, local, affordable, gardens, community, farm, use
FREX: affordability, meals, gardens, land, use, affordable, communities
Lift: 2-5x, accessed, acquisition, additional, advocacy, affordability, always
Score: land, use, affordable, affordability, agricultural, boulevards, county
Topic 2 Top Words:
Highest Prob: local, farmers, market, support, ag, produce, winter
FREX: ag, winter, enough, farmer's, living, market, costs
Lift: -or, +, 1, 1,000, 10, ability, activities
Score: winter, ag, costs, market, climate, farmer's, among
Topic 3 Top Words:
Highest Prob: food, locally, like, see, local, can, grown
FREX: grown, produced, locally, agriculture, can, food, economically
Lift: agriculture, grown, allowing, although, attend, average, barriers
Score: locally, grown, produced, can, poor, like, resource
Topic 4 Top Words:
Highest Prob: food, see, school, like, sustainable, local, land
FREX: also, space, help, school, schools, sustainable, see
Lift: $, 5-, 6, abundant, addressing, alleviate, allowed
Score: csa, space, 6, livestock, lose, never, pandemic
Topic 5 Top Words:
Highest Prob: local, food, foods, produce, stores, markets, farmers
FREX: afford, restaurants, away, foods, stores, buying, composting
Lift: away, #11, adults, alone, amounts, appealing, applaud
Score: composting, produce, buying, afford, really, even, etc
This is interesting. “Food” appears in all of the topics. This isn’t surprising but I wonder how meaningful its inclusion here is. It might be more interesting to remove it when creating my DFM and see what other words surface once it’s been removed. Given the question I think it’s safe to assume that every topic should have something to do with food.
Call:
estimateEffect(formula = 1:k ~ income, stmobj = stm_change, metadata = CFA_tidy_2)
Topic 1:
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.21748 0.03619 6.009 8.24e-09 ***
incomeBetween $25,000 and $34,999 0.01484 0.07135 0.208 0.835
incomeBetween $35,000 and $49,999 -0.01307 0.06106 -0.214 0.831
incomeBetween $50,000 and $99,999 -0.02604 0.05093 -0.511 0.610
incomeOver $250,000 -0.04965 0.09989 -0.497 0.620
incomeUnder $25,000 -0.02115 0.06156 -0.344 0.731
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Topic 2:
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.1275167 0.0396214 3.218 0.0015 **
incomeBetween $25,000 and $34,999 0.0002471 0.0725567 0.003 0.9973
incomeBetween $35,000 and $49,999 0.0396425 0.0607230 0.653 0.5146
incomeBetween $50,000 and $99,999 0.0610508 0.0530778 1.150 0.2514
incomeOver $250,000 0.0314597 0.1103214 0.285 0.7758
incomeUnder $25,000 0.1137905 0.0774979 1.468 0.1435
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Topic 3:
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.19625 0.03717 5.280 3.25e-07 ***
incomeBetween $25,000 and $34,999 0.01663 0.07021 0.237 0.813
incomeBetween $35,000 and $49,999 0.08167 0.06335 1.289 0.199
incomeBetween $50,000 and $99,999 0.00631 0.04795 0.132 0.895
incomeOver $250,000 0.15149 0.11020 1.375 0.171
incomeUnder $25,000 0.04267 0.06793 0.628 0.531
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Topic 4:
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.158981 0.038940 4.083 6.35e-05 ***
incomeBetween $25,000 and $34,999 0.005413 0.074508 0.073 0.942
incomeBetween $35,000 and $49,999 -0.047180 0.060914 -0.775 0.439
incomeBetween $50,000 and $99,999 0.054605 0.051622 1.058 0.291
incomeOver $250,000 -0.061632 0.111796 -0.551 0.582
incomeUnder $25,000 -0.060239 0.063605 -0.947 0.345
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Topic 5:
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.30094 0.04604 6.537 4.77e-10 ***
incomeBetween $25,000 and $34,999 -0.03932 0.08327 -0.472 0.637
incomeBetween $35,000 and $49,999 -0.06235 0.07328 -0.851 0.396
incomeBetween $50,000 and $99,999 -0.09631 0.06193 -1.555 0.121
incomeOver $250,000 -0.07263 0.12620 -0.576 0.566
incomeUnder $25,000 -0.07602 0.07886 -0.964 0.336
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Call:
estimateEffect(formula = 1:k ~ zip, stmobj = stm_change, metadata = CFA_tidy_2)
Topic 1:
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.04786 0.23137 0.207 0.8363
zip59801 0.16868 0.23260 0.725 0.4692
zip59802 0.10542 0.23225 0.454 0.6504
zip59803 0.06450 0.23669 0.273 0.7855
zip59804 0.39097 0.25215 1.551 0.1226
zip59808 0.14024 0.24130 0.581 0.5618
zip59821 0.07121 0.36099 0.197 0.8438
zip59823 0.30359 0.26190 1.159 0.2478
zip59825 0.13708 0.26029 0.527 0.5990
zip59826 0.55927 0.40631 1.376 0.1702
zip59833 0.18341 0.29741 0.617 0.5381
zip59846 0.07195 0.33489 0.215 0.8301
zip59847 0.07692 0.25918 0.297 0.7669
zip59860 -0.02422 0.32294 -0.075 0.9403
zip59864 0.59609 0.38994 1.529 0.1280
zip59868 0.11624 0.35782 0.325 0.7456
zip59908 0.84501 0.33656 2.511 0.0129 *
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Topic 2:
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.8387 0.3343 2.509 0.0129 *
zip59801 -0.6419 0.3338 -1.923 0.0559 .
zip59802 -0.7037 0.3324 -2.117 0.0355 *
zip59803 -0.6122 0.3486 -1.756 0.0806 .
zip59804 -0.6892 0.3480 -1.980 0.0491 *
zip59808 -0.7253 0.3401 -2.132 0.0342 *
zip59821 -0.8260 0.4326 -1.909 0.0577 .
zip59823 -0.5026 0.3591 -1.400 0.1632
zip59825 -0.5461 0.3721 -1.468 0.1438
zip59826 -0.5942 0.4894 -1.214 0.2261
zip59833 -0.7886 0.3849 -2.049 0.0418 *
zip59846 -0.7977 0.4407 -1.810 0.0718 .
zip59847 -0.7608 0.3503 -2.172 0.0310 *
zip59860 -0.8336 0.4258 -1.958 0.0517 .
zip59864 -0.7987 0.4380 -1.824 0.0697 .
zip59868 -0.8309 0.4293 -1.936 0.0544 .
zip59908 -0.8236 0.4277 -1.926 0.0556 .
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Topic 3:
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.054642 0.261012 0.209 0.834
zip59801 0.158659 0.264123 0.601 0.549
zip59802 0.192080 0.262144 0.733 0.465
zip59803 0.204604 0.271221 0.754 0.452
zip59804 0.085207 0.273207 0.312 0.755
zip59808 0.228361 0.269399 0.848 0.398
zip59821 -0.038907 0.365350 -0.106 0.915
zip59823 0.116654 0.287839 0.405 0.686
zip59825 0.170334 0.299036 0.570 0.570
zip59826 0.004978 0.370878 0.013 0.989
zip59833 0.412447 0.328869 1.254 0.211
zip59846 0.590087 0.383418 1.539 0.125
zip59847 0.202356 0.290151 0.697 0.486
zip59860 0.029166 0.364310 0.080 0.936
zip59864 0.027134 0.369502 0.073 0.942
zip59868 0.197009 0.424037 0.465 0.643
zip59908 -0.020580 0.366634 -0.056 0.955
Topic 4:
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.042778 0.260329 0.164 0.8696
zip59801 0.144437 0.260792 0.554 0.5803
zip59802 0.096848 0.264349 0.366 0.7145
zip59803 0.071826 0.269977 0.266 0.7905
zip59804 0.053355 0.274894 0.194 0.8463
zip59808 0.056534 0.268183 0.211 0.8333
zip59821 0.753220 0.399548 1.885 0.0609 .
zip59823 0.009218 0.287808 0.032 0.9745
zip59825 0.176594 0.293586 0.602 0.5482
zip59826 0.026547 0.372542 0.071 0.9433
zip59833 0.085379 0.337101 0.253 0.8003
zip59846 -0.024108 0.358635 -0.067 0.9465
zip59847 0.266370 0.298730 0.892 0.3737
zip59860 0.015152 0.378481 0.040 0.9681
zip59864 0.069680 0.375566 0.186 0.8530
zip59868 -0.009627 0.359067 -0.027 0.9786
zip59908 -0.008059 0.359995 -0.022 0.9822
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Topic 5:
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.015739 0.290036 0.054 0.9568
zip59801 0.170499 0.291528 0.585 0.5593
zip59802 0.310772 0.292193 1.064 0.2888
zip59803 0.271571 0.301134 0.902 0.3683
zip59804 0.156567 0.308156 0.508 0.6120
zip59808 0.301307 0.301814 0.998 0.3193
zip59821 0.036289 0.411887 0.088 0.9299
zip59823 0.073325 0.319813 0.229 0.8189
zip59825 0.060166 0.331664 0.181 0.8562
zip59826 0.003572 0.408674 0.009 0.9930
zip59833 0.108267 0.368802 0.294 0.7694
zip59846 0.147056 0.434504 0.338 0.7354
zip59847 0.212568 0.336875 0.631 0.5288
zip59860 0.816065 0.438273 1.862 0.0641 .
zip59864 0.109017 0.433597 0.251 0.8017
zip59868 0.526910 0.465019 1.133 0.2586
zip59908 0.008329 0.410320 0.020 0.9838
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
It appears that each income bracket is slightly positively or negatively associated with each of the five topics but that none of these associations are statistically significant. There are some statistically significant associations between some of the ZIP Codes and particular topics. However, given that I am still exploring how to preprocess my corpus into a DFM and the appropriate number of topics, I am not considering this analysis to be final. Ultimately, the sample is such (too small, not distributed over income brackets and ZIP Codes–some of the ZIP Codes have one respondent!) that it will preclude me from drawing any firm conclusions about associations anyway.
One challenge with topic modeling is that it is up to the researcher to decide how many topics (k) to include in the model. I have no sense of how to do this. Given that the corpus I am working with right now is only a few hundred short documents, I could count them manually but that will not always be feasible. It seems that the best practice is to build models with several different values for k and use various methods to evaluate those models.
In addition to thinking about how to tweak my DFM to make the results of my analysis more revealing, I also need to learn how to evaluate my models to determine which is the most appropriate. Related to that, I need to figure out how to visualize my results.
---
title: "Blog Post 5"
author: "Claire Battaglia"
desription: "Topic Models"
date: "11/13/2022"
format:
html:
toc: true
code-fold: true
code-copy: true
code-tools: true
categories:
- Claire Battaglia
- text-as-data
- blog post 5
- open-text survey response
- supervised learning
- topic models
---
```{r}
#| label: setup
#| warning: false
library(readxl)
library(plyr)
library(tidyverse)
library(tidytext)
library(quanteda)
library(stm)
knitr::opts_chunk$set(echo = TRUE)
```
In my last post I applied dictionary methods to my corpus: responses to the open-text survey question "What changes would you like to see for Missoula’s food system?" I used both the NRC and General Inquirer dictionaries to conduct a sentiment analysis but ultimately decided that this was not an appropriate analysis for my corpus. This is primarily because the survey question doesn't ask specifically about respondents' feelings about anything, meaning that a typical valid response doesn't contain either positive or negative sentiment.
I plan to create my own dictionary at some point but for this post I will be attempting to analyze my corpus using Structural Topic Modeling (STM). This method of analysis will allow me to understand both the prevalence of topics across my corpus and the content (i.e. words used to talk about) those topics. Importantly, STM will allow me to analyze the responses alongside some covariates of interest. The two that I am particularly interested in are ZIP Code and annual household income. I expect that at least the *prevalence* of topics will vary by these two covariates, if not the *content*. Keeping the long term goal of this analysis in mind, it makes a tremendous difference if respondents recommending a particular change to the food system are concentrated in a single ZIP Code or income bracket or distributed across the city/over all income brackets.
## Creating My Document Feature Matrix
I created a DFM in a previous post but I'll create a new one here because the one I previously created doesn't contain the covariates I'm interested in.
```{r load data}
# load tidy data
load("CFA_tidy.RData")
# create dfm
dfm_change <- dfm(tokens(CFA_tidy$change),
tolower = TRUE,
remove = stopwords("en"),
remove_punct = TRUE)
# get dimensions
dim(dfm_change)
```
It contains 215 rows (the responses, called documents here) and 1,146 columns (all the words that appear in the corpus).
<aside> When I first attempted to build a STM, I noticed that the `stm()` function automatically removed *NA* values but that that created problems in later functions. I went back to my tidy dataset and removed all rows that contained any *NA* values to try and address that. Of the 389 respondents, only 215 answered every question. </aside>
Now I'll take a quick look at the two covariates I am interested in: ZIP Code and annual household income.
```{r covariates}
# zip
table(CFA_tidy$zip)
# income
table(CFA_tidy$income)
```
## Correlated Topic Model
```{r ctm}
# build correlated topic model
ctm_change <- stm(dfm_change, K = 5,
verbose = FALSE, init.type = "Spectral")
# get summary
summary(ctm_change)
```
A few things to note:
* It looks like the `stm()` function automatically drops empty documents. Because I removed all rows that contained *NA* values from my tidy dataset, however, I am not sure why Text 96 is being considered "empty." I have a feeling this is going to cause problems later on.
* I specified that *k* = 5 and while that doesn't seem unreasonable, I did just make that number up.
* There are packages and functions specifically for building CTM but here I used the `stm()` function from the `stm` package because I am ultimately building a STM and not a CTM.
Next I'll use the `labelTopics()` function to take a look at the words that are associated with each of the five topics that have been revealed.
```{r label topics}
# label topics
labelTopics(ctm_change)
```
According to the [package documentation](https://cran.r-project.org/web/packages/stm/vignettes/stmVignette.pdf):
**Highest Probability** are the words with the highest probability of association with that topic .
**FREX** weights words by their overall frequency and how exclusive they are to that topic.
**Lift** weights words by dividing by their frequency in other topics.
**Score** divides the log frequency of the word in the topic by the log frequency of the word in other topics.
Next the `findThoughts()` function will allow me to see an example document that is highly associated with each of the five topics.
```{r find thoughts}
# find thoughts
findThoughts(ctm_change,
texts = CFA_tidy$change,
topics = c(1:5),
n = 1)
```
I think that this error is occurring because Text 96 was removed and so now there are 215 rows in my dataset but only 214 texts. As mentioned previously, I am not sure why Text 96 was removed so I'll take a look at it now and see if I can figure it out.
```{r text 96}
# get text 96
CFA_tidy[96,]
```
I see the problem. That row was not removed when I removed rows with *NA* values but the *change* cell contains no information in my DFM because I removed punctuation. I'll remove that row and see if that fixes the problem.
```{r remove row}
# remove row 96
CFA_tidy_2 <- subset(CFA_tidy, change !="?")
# save
save(CFA_tidy_2, file = "CFA_tidy_2.RData")
# view to check
print(CFA_tidy_2)
```
Everything looks good to me so now I'll create a new DFM from my new tidy dataset.
```{r new dfm}
# create dfm
dfm_change_2 <- dfm(tokens(CFA_tidy_2$change),
tolower = TRUE,
remove = stopwords("en"),
remove_punct = TRUE)
# save
save(dfm_change_2, file = "dfm_change_2.RData")
# get dimensions
dim(dfm_change_2)
```
```{r new ctm}
# build correlated topic model
ctm_change_2 <- stm(dfm_change_2, K = 5,
verbose = FALSE, init.type = "Spectral")
# get summary
summary(ctm_change_2)
# label topics
labelTopics(ctm_change_2)
# find thoughts
findThoughts(ctm_change_2,
texts = CFA_tidy_2$change,
topics = c(1:5),
n = 1)
```
Yes! That seems to have resolved the problem. Now I'll use the second DFM to build a STM.
## Structured Topic Model
```{r stm}
# specify number of topics
k <- 5
# specify model
stm_change <- stm(dfm_change_2,
K = k,
prevalence = ~ zip,
data = CFA_tidy_2,
max.em.its = 1000,
seed = 1234,
init.type = "Spectral")
```
```{r label topics stm}
# label topics
labelTopics(stm_change)
```
```{r plot stm}
plot(stm_change, type = "summary")
```
This is interesting. "Food" appears in all of the topics. This isn't surprising but I wonder how meaningful its inclusion here is. It might be more interesting to remove it when creating my DFM and see what other words surface once it's been removed. Given the question I think it's safe to assume that every topic *should* have something to do with food.
```{r estimate effects}
# estimate effects of income
income_effects <- estimateEffect(formula = 1:k ~ income,
stmobj = stm_change,
metadata = CFA_tidy_2)
# get summary
summary(income_effects)
# estimate effects of ZIP Code
zip_effects <- estimateEffect(formula = 1:k ~ zip,
stmobj = stm_change,
metadata = CFA_tidy_2)
# get summary
summary(zip_effects)
```
It appears that each income bracket is slightly positively or negatively associated with each of the five topics but that none of these associations are statistically significant. There are some statistically significant associations between some of the ZIP Codes and particular topics. However, given that I am still exploring how to preprocess my corpus into a DFM and the appropriate number of topics, I am not considering this analysis to be final. Ultimately, the sample is such (too small, not distributed over income brackets and ZIP Codes--some of the ZIP Codes have one respondent!) that it will preclude me from drawing any firm conclusions about associations anyway.
## Challenges and Questions Moving Forward
One challenge with topic modeling is that it is up to the researcher to decide how many topics (*k*) to include in the model. I have no sense of how to do this. Given that the corpus I am working with right now is only a few hundred short documents, I could count them manually but that will not always be feasible. It seems that the best practice is to build models with several different values for *k* and use various methods to evaluate those models.
In addition to thinking about how to tweak my DFM to make the results of my analysis more revealing, I also need to learn how to evaluate my models to determine which is the most appropriate. Related to that, I need to figure out how to visualize my results.