Claire Battaglia
text-as-data
blog post 5
open-text survey response
supervised learning
topic models
Author

Claire Battaglia

Published

November 13, 2022

Code
library(readxl)
library(plyr)
library(tidyverse)
library(tidytext)
library(quanteda)
library(stm)

knitr::opts_chunk$set(echo = TRUE)

In my last post I applied dictionary methods to my corpus: responses to the open-text survey question “What changes would you like to see for Missoula’s food system?” I used both the NRC and General Inquirer dictionaries to conduct a sentiment analysis but ultimately decided that this was not an appropriate analysis for my corpus. This is primarily because the survey question doesn’t ask specifically about respondents’ feelings about anything, meaning that a typical valid response doesn’t contain either positive or negative sentiment.

I plan to create my own dictionary at some point but for this post I will be attempting to analyze my corpus using Structural Topic Modeling (STM). This method of analysis will allow me to understand both the prevalence of topics across my corpus and the content (i.e. words used to talk about) those topics. Importantly, STM will allow me to analyze the responses alongside some covariates of interest. The two that I am particularly interested in are ZIP Code and annual household income. I expect that at least the prevalence of topics will vary by these two covariates, if not the content. Keeping the long term goal of this analysis in mind, it makes a tremendous difference if respondents recommending a particular change to the food system are concentrated in a single ZIP Code or income bracket or distributed across the city/over all income brackets.

Creating My Document Feature Matrix

I created a DFM in a previous post but I’ll create a new one here because the one I previously created doesn’t contain the covariates I’m interested in.

Code
# load tidy data
load("CFA_tidy.RData")

# create dfm
dfm_change <- dfm(tokens(CFA_tidy$change),
             tolower = TRUE,
             remove = stopwords("en"),
             remove_punct = TRUE)
Warning: '...' should not be used for tokens() arguments; use 'tokens()' first.
Warning: 'remove' is deprecated; use dfm_remove() instead
Code
# get dimensions
dim(dfm_change)
[1]  215 1146

It contains 215 rows (the responses, called documents here) and 1,146 columns (all the words that appear in the corpus).

Now I’ll take a quick look at the two covariates I am interested in: ZIP Code and annual household income.

Code
# zip
table(CFA_tidy$zip)

59701 59801 59802 59803 59804 59808 59821 59823 59825 59826 59833 59846 59847 
    1    85    62    20     9    15     1     5     4     1     2     1     5 
59860 59864 59868 59908 
    1     1     1     1 
Code
# income
table(CFA_tidy$income)

Between $100,000 and $249,999   Between $25,000 and $34,999 
                           55                            21 
  Between $35,000 and $49,999   Between $50,000 and $99,999 
                           37                            66 
                Over $250,000                 Under $25,000 
                            8                            28 

Correlated Topic Model

Code
# build correlated topic model
ctm_change <- stm(dfm_change, K = 5,
                       verbose = FALSE, init.type = "Spectral")
Warning in dfm2stm(x, docvars, omit_empty = TRUE): Dropped empty document(s):
text96
Code
# get summary
summary(ctm_change)
A topic model with 5 topics, 214 documents and a 1146 word dictionary.
Topic 1 Top Words:
     Highest Prob: affordable, local, land, less, gardens, access, farm 
     FREX: less, meals, affordable, land, communities, county, dairy 
     Lift: boulevards, less, meals, 2-5x, accessed, acquisition, additional 
     Score: affordable, land, use, affordability, less, boulevards, raised 
Topic 2 Top Words:
     Highest Prob: local, farmers, market, support, ag, produce, winter 
     FREX: ag, winter, enough, farmer's, living, market, costs 
     Lift: -or, +, 1, 1,000, 10, ability, activities 
     Score: winter, costs, ag, among, evidence-based, feeding, market 
Topic 3 Top Words:
     Highest Prob: food, locally, like, local, see, healthy, can 
     FREX: grown, produced, locally, economically, food, healthy, year 
     Lift: cans, grown, resource, allowing, attend, average, barriers 
     Score: locally, grown, poor, produced, food, can, resource 
Topic 4 Top Words:
     Highest Prob: food, see, school, like, land, local, sustainable 
     FREX: focus, also, space, school, development, help, preserve 
     Lift: $, 5-, abundant, alleviate, allowed, along, also 
     Score: csa, lose, pandemic, space, livestock, ranchers, urban 
Topic 5 Top Words:
     Highest Prob: local, foods, produce, stores, farmers, markets, community 
     FREX: afford, restaurants, away, buying, composting, even, many 
     Lift: #11, adults, alone, appealing, applaud, apple, apples 
     Score: composting, produce, afford, really, buying, shares, balance 

A few things to note:

  • It looks like the stm() function automatically drops empty documents. Because I removed all rows that contained NA values from my tidy dataset, however, I am not sure why Text 96 is being considered “empty.” I have a feeling this is going to cause problems later on.
  • I specified that k = 5 and while that doesn’t seem unreasonable, I did just make that number up.
  • There are packages and functions specifically for building CTM but here I used the stm() function from the stm package because I am ultimately building a STM and not a CTM.

Next I’ll use the labelTopics() function to take a look at the words that are associated with each of the five topics that have been revealed.

Code
# label topics
labelTopics(ctm_change)
Topic 1 Top Words:
     Highest Prob: affordable, local, land, less, gardens, access, farm 
     FREX: less, meals, affordable, land, communities, county, dairy 
     Lift: boulevards, less, meals, 2-5x, accessed, acquisition, additional 
     Score: affordable, land, use, affordability, less, boulevards, raised 
Topic 2 Top Words:
     Highest Prob: local, farmers, market, support, ag, produce, winter 
     FREX: ag, winter, enough, farmer's, living, market, costs 
     Lift: -or, +, 1, 1,000, 10, ability, activities 
     Score: winter, costs, ag, among, evidence-based, feeding, market 
Topic 3 Top Words:
     Highest Prob: food, locally, like, local, see, healthy, can 
     FREX: grown, produced, locally, economically, food, healthy, year 
     Lift: cans, grown, resource, allowing, attend, average, barriers 
     Score: locally, grown, poor, produced, food, can, resource 
Topic 4 Top Words:
     Highest Prob: food, see, school, like, land, local, sustainable 
     FREX: focus, also, space, school, development, help, preserve 
     Lift: $, 5-, abundant, alleviate, allowed, along, also 
     Score: csa, lose, pandemic, space, livestock, ranchers, urban 
Topic 5 Top Words:
     Highest Prob: local, foods, produce, stores, farmers, markets, community 
     FREX: afford, restaurants, away, buying, composting, even, many 
     Lift: #11, adults, alone, appealing, applaud, apple, apples 
     Score: composting, produce, afford, really, buying, shares, balance 

According to the package documentation:

Highest Probability are the words with the highest probability of association with that topic .

FREX weights words by their overall frequency and how exclusive they are to that topic.

Lift weights words by dividing by their frequency in other topics.

Score divides the log frequency of the word in the topic by the log frequency of the word in other topics.

Next the findThoughts() function will allow me to see an example document that is highly associated with each of the five topics.

Code
# find thoughts
findThoughts(ctm_change,
             texts = CFA_tidy$change,
             topics = c(1:5),
             n = 1)
Error in findThoughts(ctm_change, texts = CFA_tidy$change, topics = c(1:5), : Number of provided texts and number of documents modeled do not match

I think that this error is occurring because Text 96 was removed and so now there are 215 rows in my dataset but only 214 texts. As mentioned previously, I am not sure why Text 96 was removed so I’ll take a look at it now and see if I can figure it out.

Code
# get text 96
CFA_tidy[96,]
# A tibble: 1 × 5
  id          zip     age income                      change
  <chr>       <chr> <dbl> <chr>                       <chr> 
1 12981031063 59802    63 Between $50,000 and $99,999 ?     

I see the problem. That row was not removed when I removed rows with NA values but the change cell contains no information in my DFM because I removed punctuation. I’ll remove that row and see if that fixes the problem.

Code
# remove row 96
CFA_tidy_2 <- subset(CFA_tidy, change !="?")

# save
save(CFA_tidy_2, file = "CFA_tidy_2.RData")

# view to check
print(CFA_tidy_2)
# A tibble: 214 × 5
   id          zip     age income                        change                 
   <chr>       <chr> <dbl> <chr>                         <chr>                  
 1 12978141302 59823    72 Under $25,000                 "More concentration on…
 2 12991074702 59802    29 Between $50,000 and $99,999   "I'd like to see more …
 3 12985165265 59801    60 Between $50,000 and $99,999   "Factual, evidence-bas…
 4 12978197761 59801    61 Between $50,000 and $99,999   "Whatever it takes to …
 5 13020467460 59801    83 Between $35,000 and $49,999   "More competitive pric…
 6 12972697121 59802    56 Between $100,000 and $249,999 "More education about …
 7 12977827881 59803    65 Between $50,000 and $99,999   "Greater focus on loca…
 8 13003104091 59808    29 Between $35,000 and $49,999   "I applaud good food s…
 9 12981080680 59801    54 Between $100,000 and $249,999 "More policies and pro…
10 12977865121 59802    27 Under $25,000                 "An expansion of more …
# … with 204 more rows

Everything looks good to me so now I’ll create a new DFM from my new tidy dataset.

Code
# create dfm
dfm_change_2 <- dfm(tokens(CFA_tidy_2$change),
             tolower = TRUE,
             remove = stopwords("en"),
             remove_punct = TRUE)
Warning: '...' should not be used for tokens() arguments; use 'tokens()' first.
Warning: 'remove' is deprecated; use dfm_remove() instead
Code
# save
save(dfm_change_2, file = "dfm_change_2.RData")

# get dimensions
dim(dfm_change_2)
[1]  214 1146
Code
# build correlated topic model
ctm_change_2 <- stm(dfm_change_2, K = 5,
                       verbose = FALSE, init.type = "Spectral")
# get summary
summary(ctm_change_2)
A topic model with 5 topics, 214 documents and a 1146 word dictionary.
Topic 1 Top Words:
     Highest Prob: affordable, local, land, less, gardens, access, farm 
     FREX: less, meals, affordable, land, communities, county, dairy 
     Lift: boulevards, less, meals, 2-5x, accessed, acquisition, additional 
     Score: affordable, land, use, affordability, less, boulevards, raised 
Topic 2 Top Words:
     Highest Prob: local, farmers, market, support, ag, produce, winter 
     FREX: ag, winter, enough, farmer's, living, market, costs 
     Lift: -or, +, 1, 1,000, 10, ability, activities 
     Score: winter, costs, ag, among, evidence-based, feeding, market 
Topic 3 Top Words:
     Highest Prob: food, locally, like, local, see, healthy, can 
     FREX: grown, produced, locally, economically, food, healthy, year 
     Lift: cans, grown, resource, allowing, attend, average, barriers 
     Score: locally, grown, poor, produced, food, can, resource 
Topic 4 Top Words:
     Highest Prob: food, see, school, like, land, local, sustainable 
     FREX: focus, also, space, school, development, help, preserve 
     Lift: $, 5-, abundant, alleviate, allowed, along, also 
     Score: csa, lose, pandemic, space, livestock, ranchers, urban 
Topic 5 Top Words:
     Highest Prob: local, foods, produce, stores, farmers, markets, community 
     FREX: afford, restaurants, away, buying, composting, even, many 
     Lift: #11, adults, alone, appealing, applaud, apple, apples 
     Score: composting, produce, afford, really, buying, shares, balance 
Code
# label topics
labelTopics(ctm_change_2)
Topic 1 Top Words:
     Highest Prob: affordable, local, land, less, gardens, access, farm 
     FREX: less, meals, affordable, land, communities, county, dairy 
     Lift: boulevards, less, meals, 2-5x, accessed, acquisition, additional 
     Score: affordable, land, use, affordability, less, boulevards, raised 
Topic 2 Top Words:
     Highest Prob: local, farmers, market, support, ag, produce, winter 
     FREX: ag, winter, enough, farmer's, living, market, costs 
     Lift: -or, +, 1, 1,000, 10, ability, activities 
     Score: winter, costs, ag, among, evidence-based, feeding, market 
Topic 3 Top Words:
     Highest Prob: food, locally, like, local, see, healthy, can 
     FREX: grown, produced, locally, economically, food, healthy, year 
     Lift: cans, grown, resource, allowing, attend, average, barriers 
     Score: locally, grown, poor, produced, food, can, resource 
Topic 4 Top Words:
     Highest Prob: food, see, school, like, land, local, sustainable 
     FREX: focus, also, space, school, development, help, preserve 
     Lift: $, 5-, abundant, alleviate, allowed, along, also 
     Score: csa, lose, pandemic, space, livestock, ranchers, urban 
Topic 5 Top Words:
     Highest Prob: local, foods, produce, stores, farmers, markets, community 
     FREX: afford, restaurants, away, buying, composting, even, many 
     Lift: #11, adults, alone, appealing, applaud, apple, apples 
     Score: composting, produce, afford, really, buying, shares, balance 
Code
# find thoughts
findThoughts(ctm_change_2,
             texts = CFA_tidy_2$change,
             topics = c(1:5),
             n = 1)

 Topic 1: 
     Community gardens should be a part of all housing developments, the city is stacking people on top of people with no regard for consequences including burying prime agricultural land under a sea of concrete. 
 Topic 2: 
     An expansion of more produce for low income families in aid packages. The boost in farmer’s market coupons and extra produce with wic during summer is amazing but in the winter it’s just back to way too much cereal and grains which isn’t okay. One of our biggest issues in the winter is finding funds for a variety of fresh foods since everything becomes so much more expensive. I’m not vying for pineapples in January or anything but maybe an indoor farmer’s market to get greens and greenhouse crops from local farmers. That could extend the farmer’s season and provide more fresh options to missoulians that haven’t traveled 1,000+ miles 
 Topic 3: 
     I’d like to see I ncreased opportunities for preservation of irrigable lands and increased local food options (although Neva and other folks have done a good job trying). Water is a limited resource, so preservation of that resource (and valuable soils) will largely be what determines our food security into the future. 
 Topic 4: 
     The urban sprawl and development of prime farm land is a big deal. Once a subdivision is built, there is no going back.  It would also be nice if urban farms could legally raise livestock including more than 6 chickens, pigs, cows and goats. Urban farms would be more effficient systems if they were allowed to integrate livestock into their farming systems. For example, grazing animals to keep grass and weeds down, pigs to feed farm/food waste too, and all of the manure to compost and use for fertilizer. 
 Topic 5: 
     More community garden plots in underserved areas with regular on site support to teach families (or even just kids)  to plant, grow and harvest.  Sometimes kids want a better life than their parents are willing or able to provide.

Yes! That seems to have resolved the problem. Now I’ll use the second DFM to build a STM.

Structured Topic Model

Code
# specify number of topics
k <- 5

# specify model
stm_change <- stm(dfm_change_2,
               K = k,
               prevalence = ~ zip,
               data = CFA_tidy_2,
               max.em.its = 1000,
               seed = 1234,
               init.type = "Spectral")
Beginning Spectral Initialization 
     Calculating the gram matrix...
     Finding anchor words...
    .....
     Recovering initialization...
    ...........
Initialization complete.
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 1 (approx. per word bound = -6.398) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 2 (approx. per word bound = -6.250, relative change = 2.321e-02) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 3 (approx. per word bound = -6.202, relative change = 7.664e-03) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 4 (approx. per word bound = -6.182, relative change = 3.212e-03) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 5 (approx. per word bound = -6.172, relative change = 1.653e-03) 
Topic 1: land, affordable, access, gardens, less 
 Topic 2: farmers, local, support, can, greater 
 Topic 3: food, like, healthy, available, farmland 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: see, community, produce, options, foods 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 6 (approx. per word bound = -6.165, relative change = 1.027e-03) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 7 (approx. per word bound = -6.160, relative change = 7.865e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 8 (approx. per word bound = -6.156, relative change = 7.148e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 9 (approx. per word bound = -6.152, relative change = 6.832e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 10 (approx. per word bound = -6.148, relative change = 5.817e-04) 
Topic 1: land, affordable, access, gardens, less 
 Topic 2: farmers, local, support, can, market 
 Topic 3: food, like, healthy, locally, available 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: see, community, produce, foods, options 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 11 (approx. per word bound = -6.146, relative change = 4.422e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 12 (approx. per word bound = -6.143, relative change = 3.470e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 13 (approx. per word bound = -6.142, relative change = 2.922e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 14 (approx. per word bound = -6.140, relative change = 2.559e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 15 (approx. per word bound = -6.139, relative change = 2.471e-04) 
Topic 1: land, affordable, access, gardens, less 
 Topic 2: farmers, local, support, can, market 
 Topic 3: food, like, healthy, locally, available 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: see, community, produce, foods, options 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 16 (approx. per word bound = -6.137, relative change = 2.756e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 17 (approx. per word bound = -6.135, relative change = 3.130e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 18 (approx. per word bound = -6.133, relative change = 3.081e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 19 (approx. per word bound = -6.131, relative change = 2.784e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 20 (approx. per word bound = -6.130, relative change = 2.587e-04) 
Topic 1: land, affordable, access, gardens, less 
 Topic 2: farmers, local, support, can, market 
 Topic 3: food, like, healthy, locally, available 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: see, community, produce, foods, options 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 21 (approx. per word bound = -6.128, relative change = 2.594e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 22 (approx. per word bound = -6.126, relative change = 2.691e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 23 (approx. per word bound = -6.125, relative change = 2.793e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 24 (approx. per word bound = -6.123, relative change = 3.079e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 25 (approx. per word bound = -6.121, relative change = 3.509e-04) 
Topic 1: land, affordable, access, gardens, less 
 Topic 2: farmers, local, support, can, market 
 Topic 3: food, like, healthy, locally, available 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: see, community, produce, foods, options 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 26 (approx. per word bound = -6.119, relative change = 3.594e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 27 (approx. per word bound = -6.117, relative change = 3.240e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 28 (approx. per word bound = -6.115, relative change = 3.260e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 29 (approx. per word bound = -6.112, relative change = 3.825e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 30 (approx. per word bound = -6.110, relative change = 4.397e-04) 
Topic 1: land, affordable, access, gardens, less 
 Topic 2: farmers, local, support, can, market 
 Topic 3: food, like, healthy, locally, available 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: see, community, local, produce, foods 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 31 (approx. per word bound = -6.107, relative change = 4.275e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 32 (approx. per word bound = -6.105, relative change = 3.947e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 33 (approx. per word bound = -6.102, relative change = 3.707e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 34 (approx. per word bound = -6.100, relative change = 3.529e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 35 (approx. per word bound = -6.098, relative change = 3.726e-04) 
Topic 1: land, affordable, access, gardens, less 
 Topic 2: farmers, local, support, can, market 
 Topic 3: food, like, locally, healthy, available 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: see, local, community, foods, produce 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 36 (approx. per word bound = -6.095, relative change = 4.394e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 37 (approx. per word bound = -6.092, relative change = 4.966e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 38 (approx. per word bound = -6.089, relative change = 4.751e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 39 (approx. per word bound = -6.087, relative change = 4.320e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 40 (approx. per word bound = -6.084, relative change = 4.320e-04) 
Topic 1: land, affordable, access, gardens, less 
 Topic 2: farmers, local, support, can, market 
 Topic 3: food, like, locally, healthy, available 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: local, see, community, foods, options 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 41 (approx. per word bound = -6.081, relative change = 5.267e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 42 (approx. per word bound = -6.077, relative change = 5.872e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 43 (approx. per word bound = -6.074, relative change = 4.869e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 44 (approx. per word bound = -6.071, relative change = 4.671e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 45 (approx. per word bound = -6.068, relative change = 5.378e-04) 
Topic 1: land, affordable, access, gardens, less 
 Topic 2: farmers, local, support, can, market 
 Topic 3: food, like, locally, healthy, available 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: local, see, community, foods, options 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 46 (approx. per word bound = -6.065, relative change = 5.821e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 47 (approx. per word bound = -6.062, relative change = 4.025e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 48 (approx. per word bound = -6.060, relative change = 3.454e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 49 (approx. per word bound = -6.058, relative change = 3.431e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 50 (approx. per word bound = -6.056, relative change = 2.968e-04) 
Topic 1: land, affordable, access, gardens, less 
 Topic 2: farmers, local, support, can, market 
 Topic 3: food, like, locally, healthy, available 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: local, see, community, foods, options 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 51 (approx. per word bound = -6.054, relative change = 3.024e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 52 (approx. per word bound = -6.052, relative change = 3.334e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 53 (approx. per word bound = -6.050, relative change = 3.357e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 54 (approx. per word bound = -6.048, relative change = 3.172e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 55 (approx. per word bound = -6.046, relative change = 3.722e-04) 
Topic 1: land, affordable, access, gardens, less 
 Topic 2: farmers, local, support, can, market 
 Topic 3: food, like, locally, healthy, available 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: local, see, community, foods, options 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 56 (approx. per word bound = -6.043, relative change = 5.188e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 57 (approx. per word bound = -6.039, relative change = 6.634e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 58 (approx. per word bound = -6.035, relative change = 6.552e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 59 (approx. per word bound = -6.032, relative change = 5.808e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 60 (approx. per word bound = -6.028, relative change = 5.253e-04) 
Topic 1: land, affordable, gardens, access, less 
 Topic 2: farmers, local, support, can, market 
 Topic 3: food, like, locally, healthy, available 
 Topic 4: local, farm, sustainable, missoula, stores 
 Topic 5: local, see, community, foods, options 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 61 (approx. per word bound = -6.025, relative change = 4.958e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 62 (approx. per word bound = -6.022, relative change = 5.073e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 63 (approx. per word bound = -6.019, relative change = 5.470e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 64 (approx. per word bound = -6.015, relative change = 6.087e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 65 (approx. per word bound = -6.012, relative change = 6.376e-04) 
Topic 1: land, affordable, gardens, less, use 
 Topic 2: farmers, local, support, market, good 
 Topic 3: food, like, locally, healthy, available 
 Topic 4: local, farm, sustainable, missoula, education 
 Topic 5: local, see, foods, options, community 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 66 (approx. per word bound = -6.008, relative change = 5.787e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 67 (approx. per word bound = -6.005, relative change = 5.584e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 68 (approx. per word bound = -6.001, relative change = 5.969e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 69 (approx. per word bound = -5.999, relative change = 4.284e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 70 (approx. per word bound = -5.997, relative change = 3.320e-04) 
Topic 1: land, affordable, gardens, less, use 
 Topic 2: farmers, local, support, community, market 
 Topic 3: food, like, locally, healthy, available 
 Topic 4: local, farm, sustainable, missoula, education 
 Topic 5: local, see, foods, options, produce 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 71 (approx. per word bound = -5.995, relative change = 3.242e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 72 (approx. per word bound = -5.993, relative change = 3.386e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 73 (approx. per word bound = -5.990, relative change = 4.082e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 74 (approx. per word bound = -5.987, relative change = 5.037e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 75 (approx. per word bound = -5.984, relative change = 4.910e-04) 
Topic 1: land, affordable, gardens, less, use 
 Topic 2: farmers, local, community, support, market 
 Topic 3: food, like, locally, healthy, available 
 Topic 4: farm, local, sustainable, missoula, see 
 Topic 5: local, foods, options, see, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 76 (approx. per word bound = -5.982, relative change = 4.227e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 77 (approx. per word bound = -5.979, relative change = 3.684e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 78 (approx. per word bound = -5.977, relative change = 3.353e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 79 (approx. per word bound = -5.975, relative change = 3.315e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 80 (approx. per word bound = -5.974, relative change = 3.226e-04) 
Topic 1: land, affordable, gardens, less, use 
 Topic 2: farmers, local, community, support, market 
 Topic 3: food, like, locally, healthy, grown 
 Topic 4: see, farm, local, sustainable, missoula 
 Topic 5: local, foods, options, grocery, produce 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 81 (approx. per word bound = -5.971, relative change = 3.434e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 82 (approx. per word bound = -5.969, relative change = 3.955e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 83 (approx. per word bound = -5.966, relative change = 4.873e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 84 (approx. per word bound = -5.963, relative change = 5.699e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 85 (approx. per word bound = -5.959, relative change = 5.858e-04) 
Topic 1: land, affordable, gardens, less, use 
 Topic 2: farmers, local, support, community, market 
 Topic 3: food, like, locally, healthy, grown 
 Topic 4: see, farm, sustainable, local, missoula 
 Topic 5: local, foods, options, grocery, produce 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 86 (approx. per word bound = -5.956, relative change = 5.787e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 87 (approx. per word bound = -5.953, relative change = 5.368e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 88 (approx. per word bound = -5.950, relative change = 5.085e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 89 (approx. per word bound = -5.946, relative change = 5.606e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 90 (approx. per word bound = -5.943, relative change = 6.353e-04) 
Topic 1: land, affordable, gardens, less, use 
 Topic 2: farmers, local, support, market, community 
 Topic 3: food, like, locally, healthy, grown 
 Topic 4: see, farm, sustainable, local, missoula 
 Topic 5: local, foods, options, grocery, stores 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 91 (approx. per word bound = -5.939, relative change = 5.806e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 92 (approx. per word bound = -5.936, relative change = 5.362e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 93 (approx. per word bound = -5.933, relative change = 4.770e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 94 (approx. per word bound = -5.931, relative change = 4.080e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 95 (approx. per word bound = -5.928, relative change = 3.750e-04) 
Topic 1: land, affordable, gardens, less, agricultural 
 Topic 2: local, farmers, support, market, fresh 
 Topic 3: food, like, locally, healthy, grown 
 Topic 4: see, sustainable, farm, local, missoula 
 Topic 5: local, foods, options, grocery, stores 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 96 (approx. per word bound = -5.926, relative change = 4.124e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 97 (approx. per word bound = -5.924, relative change = 4.138e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 98 (approx. per word bound = -5.921, relative change = 4.066e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 99 (approx. per word bound = -5.919, relative change = 3.831e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 100 (approx. per word bound = -5.917, relative change = 3.747e-04) 
Topic 1: land, affordable, gardens, less, use 
 Topic 2: local, farmers, support, market, fresh 
 Topic 3: food, like, locally, healthy, grown 
 Topic 4: see, sustainable, farm, local, missoula 
 Topic 5: local, options, foods, grocery, stores 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 101 (approx. per word bound = -5.915, relative change = 3.494e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 102 (approx. per word bound = -5.913, relative change = 2.953e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 103 (approx. per word bound = -5.911, relative change = 2.463e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 104 (approx. per word bound = -5.910, relative change = 2.248e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 105 (approx. per word bound = -5.909, relative change = 2.383e-04) 
Topic 1: land, affordable, gardens, less, use 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, healthy, grown 
 Topic 4: see, sustainable, farm, local, school 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 106 (approx. per word bound = -5.907, relative change = 2.579e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 107 (approx. per word bound = -5.906, relative change = 2.614e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 108 (approx. per word bound = -5.904, relative change = 2.279e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 109 (approx. per word bound = -5.903, relative change = 1.897e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 110 (approx. per word bound = -5.902, relative change = 1.750e-04) 
Topic 1: land, affordable, gardens, less, use 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, healthy, see 
 Topic 4: see, sustainable, farm, local, school 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 111 (approx. per word bound = -5.901, relative change = 1.780e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 112 (approx. per word bound = -5.900, relative change = 2.055e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 113 (approx. per word bound = -5.898, relative change = 2.446e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 114 (approx. per word bound = -5.897, relative change = 2.639e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 115 (approx. per word bound = -5.895, relative change = 2.796e-04) 
Topic 1: land, affordable, gardens, less, use 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, healthy, see 
 Topic 4: sustainable, farm, see, local, school 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 116 (approx. per word bound = -5.894, relative change = 2.738e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 117 (approx. per word bound = -5.892, relative change = 2.161e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 118 (approx. per word bound = -5.891, relative change = 1.812e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 119 (approx. per word bound = -5.890, relative change = 1.784e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 120 (approx. per word bound = -5.889, relative change = 1.584e-04) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, local, see, farm, school 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 121 (approx. per word bound = -5.888, relative change = 1.270e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 122 (approx. per word bound = -5.888, relative change = 1.066e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 123 (approx. per word bound = -5.887, relative change = 8.903e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 124 (approx. per word bound = -5.887, relative change = 8.058e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 125 (approx. per word bound = -5.886, relative change = 8.432e-05) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, local, farm, see, school 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 126 (approx. per word bound = -5.886, relative change = 9.201e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 127 (approx. per word bound = -5.885, relative change = 9.095e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 128 (approx. per word bound = -5.885, relative change = 8.762e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 129 (approx. per word bound = -5.884, relative change = 9.963e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 130 (approx. per word bound = -5.883, relative change = 1.155e-04) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, local, farm, see, school 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 131 (approx. per word bound = -5.883, relative change = 1.255e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 132 (approx. per word bound = -5.882, relative change = 1.531e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 133 (approx. per word bound = -5.881, relative change = 2.066e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 134 (approx. per word bound = -5.879, relative change = 2.520e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 135 (approx. per word bound = -5.878, relative change = 2.635e-04) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, local, see, farm, school 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 136 (approx. per word bound = -5.876, relative change = 2.852e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 137 (approx. per word bound = -5.874, relative change = 2.993e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 138 (approx. per word bound = -5.873, relative change = 2.657e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 139 (approx. per word bound = -5.871, relative change = 2.136e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 140 (approx. per word bound = -5.870, relative change = 1.809e-04) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, see, local, school, farm 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 141 (approx. per word bound = -5.869, relative change = 1.843e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 142 (approx. per word bound = -5.868, relative change = 2.126e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 143 (approx. per word bound = -5.867, relative change = 2.206e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 144 (approx. per word bound = -5.865, relative change = 2.248e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 145 (approx. per word bound = -5.864, relative change = 2.827e-04) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, see, school, local, farm 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 146 (approx. per word bound = -5.862, relative change = 3.053e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 147 (approx. per word bound = -5.861, relative change = 1.899e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 148 (approx. per word bound = -5.860, relative change = 1.260e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 149 (approx. per word bound = -5.859, relative change = 1.322e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 150 (approx. per word bound = -5.859, relative change = 1.189e-04) 
Topic 1: land, affordable, community, gardens, less 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, healthy, see 
 Topic 4: sustainable, see, local, school, farm 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 151 (approx. per word bound = -5.858, relative change = 8.199e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 152 (approx. per word bound = -5.858, relative change = 5.742e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 153 (approx. per word bound = -5.857, relative change = 5.132e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 154 (approx. per word bound = -5.857, relative change = 5.407e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 155 (approx. per word bound = -5.857, relative change = 6.077e-05) 
Topic 1: land, affordable, community, gardens, less 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, healthy, see 
 Topic 4: sustainable, see, local, school, farm 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 156 (approx. per word bound = -5.856, relative change = 7.027e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 157 (approx. per word bound = -5.856, relative change = 8.719e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 158 (approx. per word bound = -5.855, relative change = 1.010e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 159 (approx. per word bound = -5.855, relative change = 8.602e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 160 (approx. per word bound = -5.854, relative change = 8.787e-05) 
Topic 1: land, affordable, community, gardens, less 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, healthy, see 
 Topic 4: sustainable, see, local, school, farm 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 161 (approx. per word bound = -5.854, relative change = 8.793e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 162 (approx. per word bound = -5.853, relative change = 8.845e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 163 (approx. per word bound = -5.853, relative change = 1.066e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 164 (approx. per word bound = -5.852, relative change = 1.061e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 165 (approx. per word bound = -5.851, relative change = 8.141e-05) 
Topic 1: land, affordable, community, gardens, less 
 Topic 2: local, farmers, market, support, fresh 
 Topic 3: food, like, locally, healthy, see 
 Topic 4: sustainable, see, local, school, farm 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 166 (approx. per word bound = -5.851, relative change = 6.358e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 167 (approx. per word bound = -5.851, relative change = 5.734e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 168 (approx. per word bound = -5.850, relative change = 5.347e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 169 (approx. per word bound = -5.850, relative change = 5.439e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 170 (approx. per word bound = -5.850, relative change = 5.610e-05) 
Topic 1: land, affordable, community, gardens, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, like, locally, healthy, see 
 Topic 4: sustainable, see, local, school, farm 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 171 (approx. per word bound = -5.849, relative change = 5.923e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 172 (approx. per word bound = -5.849, relative change = 6.217e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 173 (approx. per word bound = -5.849, relative change = 6.467e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 174 (approx. per word bound = -5.848, relative change = 6.580e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 175 (approx. per word bound = -5.848, relative change = 6.858e-05) 
Topic 1: land, affordable, community, gardens, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, see, local, school, farm 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 176 (approx. per word bound = -5.847, relative change = 7.786e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 177 (approx. per word bound = -5.847, relative change = 8.521e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 178 (approx. per word bound = -5.846, relative change = 8.385e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 179 (approx. per word bound = -5.846, relative change = 8.154e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 180 (approx. per word bound = -5.846, relative change = 8.008e-05) 
Topic 1: land, affordable, community, gardens, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, see, local, school, farm 
 Topic 5: local, foods, options, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 181 (approx. per word bound = -5.845, relative change = 7.668e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 182 (approx. per word bound = -5.845, relative change = 7.475e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 183 (approx. per word bound = -5.844, relative change = 7.932e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 184 (approx. per word bound = -5.844, relative change = 9.537e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 185 (approx. per word bound = -5.843, relative change = 1.156e-04) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, see, local, school, like 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 186 (approx. per word bound = -5.842, relative change = 1.123e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 187 (approx. per word bound = -5.842, relative change = 1.074e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 188 (approx. per word bound = -5.841, relative change = 1.205e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 189 (approx. per word bound = -5.840, relative change = 1.345e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 190 (approx. per word bound = -5.839, relative change = 1.283e-04) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, see, school, local, like 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 191 (approx. per word bound = -5.839, relative change = 1.162e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 192 (approx. per word bound = -5.838, relative change = 1.047e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 193 (approx. per word bound = -5.838, relative change = 9.846e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 194 (approx. per word bound = -5.837, relative change = 9.920e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 195 (approx. per word bound = -5.836, relative change = 1.016e-04) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, see, school, local, like 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 196 (approx. per word bound = -5.836, relative change = 9.748e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 197 (approx. per word bound = -5.835, relative change = 9.045e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 198 (approx. per word bound = -5.835, relative change = 1.368e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 199 (approx. per word bound = -5.832, relative change = 3.683e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 200 (approx. per word bound = -5.831, relative change = 2.454e-04) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, see, school, local, like 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 201 (approx. per word bound = -5.831, relative change = 6.402e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 202 (approx. per word bound = -5.830, relative change = 5.569e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 203 (approx. per word bound = -5.830, relative change = 6.317e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 204 (approx. per word bound = -5.829, relative change = 7.686e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 205 (approx. per word bound = -5.829, relative change = 9.054e-05) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, like, locally, see, healthy 
 Topic 4: sustainable, see, school, like, local 
 Topic 5: local, options, foods, stores, grocery 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 206 (approx. per word bound = -5.828, relative change = 1.052e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 207 (approx. per word bound = -5.828, relative change = 1.290e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 208 (approx. per word bound = -5.827, relative change = 1.622e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 209 (approx. per word bound = -5.825, relative change = 1.866e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 210 (approx. per word bound = -5.824, relative change = 1.791e-04) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: sustainable, see, school, like, local 
 Topic 5: local, options, foods, stores, produce 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 211 (approx. per word bound = -5.824, relative change = 1.434e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 212 (approx. per word bound = -5.823, relative change = 1.080e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 213 (approx. per word bound = -5.823, relative change = 8.101e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 214 (approx. per word bound = -5.822, relative change = 6.048e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 215 (approx. per word bound = -5.822, relative change = 4.626e-05) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, see, sustainable, school, like 
 Topic 5: local, options, foods, stores, produce 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 216 (approx. per word bound = -5.822, relative change = 3.734e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 217 (approx. per word bound = -5.821, relative change = 3.090e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 218 (approx. per word bound = -5.821, relative change = 2.577e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 219 (approx. per word bound = -5.821, relative change = 2.060e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 220 (approx. per word bound = -5.821, relative change = 1.813e-05) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, see, sustainable, school, like 
 Topic 5: local, options, foods, stores, produce 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 221 (approx. per word bound = -5.821, relative change = 1.593e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 222 (approx. per word bound = -5.821, relative change = 1.827e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 223 (approx. per word bound = -5.821, relative change = 2.477e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 224 (approx. per word bound = -5.821, relative change = 3.736e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 225 (approx. per word bound = -5.820, relative change = 5.417e-05) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, see, sustainable, school, like 
 Topic 5: local, options, foods, stores, produce 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 226 (approx. per word bound = -5.820, relative change = 7.089e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 227 (approx. per word bound = -5.819, relative change = 7.482e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 228 (approx. per word bound = -5.819, relative change = 6.728e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 229 (approx. per word bound = -5.819, relative change = 5.577e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 230 (approx. per word bound = -5.818, relative change = 5.427e-05) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, see, sustainable, school, like 
 Topic 5: local, options, foods, produce, stores 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 231 (approx. per word bound = -5.818, relative change = 6.374e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 232 (approx. per word bound = -5.818, relative change = 7.807e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 233 (approx. per word bound = -5.817, relative change = 9.332e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 234 (approx. per word bound = -5.816, relative change = 1.185e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 235 (approx. per word bound = -5.815, relative change = 1.591e-04) 
Topic 1: land, affordable, gardens, community, less 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, see, sustainable, school, like 
 Topic 5: local, options, foods, produce, stores 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 236 (approx. per word bound = -5.814, relative change = 2.012e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 237 (approx. per word bound = -5.813, relative change = 2.291e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 238 (approx. per word bound = -5.811, relative change = 2.399e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 239 (approx. per word bound = -5.810, relative change = 2.031e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 240 (approx. per word bound = -5.809, relative change = 1.480e-04) 
Topic 1: land, affordable, local, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, sustainable, see, school, like 
 Topic 5: local, foods, options, produce, stores 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 241 (approx. per word bound = -5.809, relative change = 1.115e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 242 (approx. per word bound = -5.808, relative change = 9.122e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 243 (approx. per word bound = -5.808, relative change = 8.486e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 244 (approx. per word bound = -5.807, relative change = 9.119e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 245 (approx. per word bound = -5.807, relative change = 9.245e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, sustainable, see, school, like 
 Topic 5: local, foods, options, produce, stores 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 246 (approx. per word bound = -5.806, relative change = 8.117e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 247 (approx. per word bound = -5.806, relative change = 6.862e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 248 (approx. per word bound = -5.805, relative change = 6.613e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 249 (approx. per word bound = -5.805, relative change = 8.342e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 250 (approx. per word bound = -5.804, relative change = 1.142e-04) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, sustainable, see, school, like 
 Topic 5: local, foods, options, produce, stores 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 251 (approx. per word bound = -5.804, relative change = 1.063e-04) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 252 (approx. per word bound = -5.803, relative change = 7.167e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 253 (approx. per word bound = -5.803, relative change = 7.164e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 254 (approx. per word bound = -5.802, relative change = 7.973e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 255 (approx. per word bound = -5.802, relative change = 8.326e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, sustainable, see, school, like 
 Topic 5: local, foods, produce, stores, options 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 256 (approx. per word bound = -5.801, relative change = 8.798e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 257 (approx. per word bound = -5.801, relative change = 9.482e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 258 (approx. per word bound = -5.800, relative change = 8.003e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 259 (approx. per word bound = -5.800, relative change = 6.215e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 260 (approx. per word bound = -5.800, relative change = 6.098e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, see, sustainable, school, like 
 Topic 5: local, foods, produce, stores, farmers 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 261 (approx. per word bound = -5.799, relative change = 7.173e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 262 (approx. per word bound = -5.799, relative change = 8.513e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 263 (approx. per word bound = -5.798, relative change = 8.433e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 264 (approx. per word bound = -5.798, relative change = 7.737e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 265 (approx. per word bound = -5.797, relative change = 7.002e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, farmers 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 266 (approx. per word bound = -5.797, relative change = 6.682e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 267 (approx. per word bound = -5.797, relative change = 6.289e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 268 (approx. per word bound = -5.796, relative change = 6.042e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 269 (approx. per word bound = -5.796, relative change = 6.077e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 270 (approx. per word bound = -5.796, relative change = 5.963e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, healthy, see 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, farmers 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 271 (approx. per word bound = -5.795, relative change = 5.796e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 272 (approx. per word bound = -5.795, relative change = 5.250e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 273 (approx. per word bound = -5.795, relative change = 4.113e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 274 (approx. per word bound = -5.795, relative change = 3.074e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 275 (approx. per word bound = -5.794, relative change = 2.242e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, healthy 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, farmers 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 276 (approx. per word bound = -5.794, relative change = 1.955e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 277 (approx. per word bound = -5.794, relative change = 1.871e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 278 (approx. per word bound = -5.794, relative change = 2.293e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 279 (approx. per word bound = -5.794, relative change = 2.656e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 280 (approx. per word bound = -5.794, relative change = 3.293e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, healthy 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, farmers 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 281 (approx. per word bound = -5.794, relative change = 3.701e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 282 (approx. per word bound = -5.793, relative change = 4.061e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 283 (approx. per word bound = -5.793, relative change = 4.190e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 284 (approx. per word bound = -5.793, relative change = 4.021e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 285 (approx. per word bound = -5.793, relative change = 3.348e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, healthy 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, farmers 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 286 (approx. per word bound = -5.792, relative change = 2.568e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 287 (approx. per word bound = -5.792, relative change = 2.197e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 288 (approx. per word bound = -5.792, relative change = 2.474e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 289 (approx. per word bound = -5.792, relative change = 3.090e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 290 (approx. per word bound = -5.792, relative change = 3.925e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, healthy 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, farmers 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 291 (approx. per word bound = -5.791, relative change = 4.891e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 292 (approx. per word bound = -5.791, relative change = 5.725e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 293 (approx. per word bound = -5.791, relative change = 5.918e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 294 (approx. per word bound = -5.790, relative change = 5.722e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 295 (approx. per word bound = -5.790, relative change = 5.238e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, healthy 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, farmers 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 296 (approx. per word bound = -5.790, relative change = 5.622e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 297 (approx. per word bound = -5.790, relative change = 5.906e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 298 (approx. per word bound = -5.789, relative change = 4.874e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 299 (approx. per word bound = -5.789, relative change = 4.356e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 300 (approx. per word bound = -5.789, relative change = 4.721e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, healthy 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, farmers 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 301 (approx. per word bound = -5.788, relative change = 5.139e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 302 (approx. per word bound = -5.788, relative change = 5.714e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 303 (approx. per word bound = -5.788, relative change = 5.076e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 304 (approx. per word bound = -5.788, relative change = 4.150e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 305 (approx. per word bound = -5.787, relative change = 3.871e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, can 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, farmers 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 306 (approx. per word bound = -5.787, relative change = 3.941e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 307 (approx. per word bound = -5.787, relative change = 4.397e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 308 (approx. per word bound = -5.787, relative change = 5.037e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 309 (approx. per word bound = -5.786, relative change = 5.516e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 310 (approx. per word bound = -5.786, relative change = 5.572e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, local 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, markets 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 311 (approx. per word bound = -5.786, relative change = 5.669e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 312 (approx. per word bound = -5.785, relative change = 5.055e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 313 (approx. per word bound = -5.785, relative change = 3.813e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 314 (approx. per word bound = -5.785, relative change = 3.227e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 315 (approx. per word bound = -5.785, relative change = 4.058e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, local 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, markets 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 316 (approx. per word bound = -5.784, relative change = 8.984e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 317 (approx. per word bound = -5.784, relative change = 9.037e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 318 (approx. per word bound = -5.783, relative change = 5.704e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 319 (approx. per word bound = -5.783, relative change = 3.690e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 320 (approx. per word bound = -5.783, relative change = 3.306e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, local 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, markets 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 321 (approx. per word bound = -5.783, relative change = 4.649e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 322 (approx. per word bound = -5.782, relative change = 3.189e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 323 (approx. per word bound = -5.782, relative change = 1.795e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 324 (approx. per word bound = -5.782, relative change = 1.344e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 325 (approx. per word bound = -5.782, relative change = 1.234e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, local 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, markets 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 326 (approx. per word bound = -5.782, relative change = 1.167e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 327 (approx. per word bound = -5.782, relative change = 1.125e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 328 (approx. per word bound = -5.782, relative change = 1.169e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 329 (approx. per word bound = -5.782, relative change = 1.109e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 330 (approx. per word bound = -5.782, relative change = 1.241e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, local 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, markets 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 331 (approx. per word bound = -5.782, relative change = 1.313e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 332 (approx. per word bound = -5.782, relative change = 1.527e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 333 (approx. per word bound = -5.782, relative change = 1.759e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 334 (approx. per word bound = -5.781, relative change = 2.042e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 335 (approx. per word bound = -5.781, relative change = 2.411e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, local 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, markets 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 336 (approx. per word bound = -5.781, relative change = 2.802e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 337 (approx. per word bound = -5.781, relative change = 3.259e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 338 (approx. per word bound = -5.781, relative change = 3.561e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 339 (approx. per word bound = -5.781, relative change = 3.923e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 340 (approx. per word bound = -5.780, relative change = 4.435e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, local 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, markets 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 341 (approx. per word bound = -5.780, relative change = 5.070e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 342 (approx. per word bound = -5.780, relative change = 5.712e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 343 (approx. per word bound = -5.779, relative change = 6.445e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 344 (approx. per word bound = -5.779, relative change = 6.447e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 345 (approx. per word bound = -5.779, relative change = 5.145e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, local 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, markets 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 346 (approx. per word bound = -5.778, relative change = 4.267e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 347 (approx. per word bound = -5.778, relative change = 4.199e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 348 (approx. per word bound = -5.778, relative change = 4.607e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 349 (approx. per word bound = -5.778, relative change = 5.217e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 350 (approx. per word bound = -5.777, relative change = 5.495e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, local 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, produce, stores, food 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 351 (approx. per word bound = -5.777, relative change = 5.200e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 352 (approx. per word bound = -5.777, relative change = 4.680e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 353 (approx. per word bound = -5.776, relative change = 4.322e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 354 (approx. per word bound = -5.776, relative change = 3.692e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 355 (approx. per word bound = -5.776, relative change = 2.984e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, local 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, foods, food, produce, stores 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 356 (approx. per word bound = -5.776, relative change = 2.228e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 357 (approx. per word bound = -5.776, relative change = 1.806e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 358 (approx. per word bound = -5.776, relative change = 1.819e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 359 (approx. per word bound = -5.776, relative change = 2.104e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 360 (approx. per word bound = -5.775, relative change = 2.454e-05) 
Topic 1: land, local, affordable, gardens, community 
 Topic 2: local, farmers, market, support, ag 
 Topic 3: food, locally, like, see, local 
 Topic 4: food, see, school, like, sustainable 
 Topic 5: local, food, foods, produce, stores 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 361 (approx. per word bound = -5.775, relative change = 2.165e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Completing Iteration 362 (approx. per word bound = -5.775, relative change = 1.327e-05) 
...........................................................................................................
Completed E-Step (0 seconds). 
Completed M-Step. 
Model Converged 
Code
# label topics
labelTopics(stm_change)
Topic 1 Top Words:
     Highest Prob: land, local, affordable, gardens, community, farm, use 
     FREX: affordability, meals, gardens, land, use, affordable, communities 
     Lift: 2-5x, accessed, acquisition, additional, advocacy, affordability, always 
     Score: land, use, affordable, affordability, agricultural, boulevards, county 
Topic 2 Top Words:
     Highest Prob: local, farmers, market, support, ag, produce, winter 
     FREX: ag, winter, enough, farmer's, living, market, costs 
     Lift: -or, +, 1, 1,000, 10, ability, activities 
     Score: winter, ag, costs, market, climate, farmer's, among 
Topic 3 Top Words:
     Highest Prob: food, locally, like, see, local, can, grown 
     FREX: grown, produced, locally, agriculture, can, food, economically 
     Lift: agriculture, grown, allowing, although, attend, average, barriers 
     Score: locally, grown, produced, can, poor, like, resource 
Topic 4 Top Words:
     Highest Prob: food, see, school, like, sustainable, local, land 
     FREX: also, space, help, school, schools, sustainable, see 
     Lift: $, 5-, 6, abundant, addressing, alleviate, allowed 
     Score: csa, space, 6, livestock, lose, never, pandemic 
Topic 5 Top Words:
     Highest Prob: local, food, foods, produce, stores, markets, farmers 
     FREX: afford, restaurants, away, foods, stores, buying, composting 
     Lift: away, #11, adults, alone, amounts, appealing, applaud 
     Score: composting, produce, buying, afford, really, even, etc 
Code
plot(stm_change, type = "summary")

This is interesting. “Food” appears in all of the topics. This isn’t surprising but I wonder how meaningful its inclusion here is. It might be more interesting to remove it when creating my DFM and see what other words surface once it’s been removed. Given the question I think it’s safe to assume that every topic should have something to do with food.

Code
# estimate effects of income
income_effects <- estimateEffect(formula = 1:k ~ income,
                               stmobj = stm_change,
                               metadata = CFA_tidy_2)

# get summary
summary(income_effects)

Call:
estimateEffect(formula = 1:k ~ income, stmobj = stm_change, metadata = CFA_tidy_2)


Topic 1:

Coefficients:
                                  Estimate Std. Error t value Pr(>|t|)    
(Intercept)                        0.21748    0.03619   6.009 8.24e-09 ***
incomeBetween $25,000 and $34,999  0.01484    0.07135   0.208    0.835    
incomeBetween $35,000 and $49,999 -0.01307    0.06106  -0.214    0.831    
incomeBetween $50,000 and $99,999 -0.02604    0.05093  -0.511    0.610    
incomeOver $250,000               -0.04965    0.09989  -0.497    0.620    
incomeUnder $25,000               -0.02115    0.06156  -0.344    0.731    
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1


Topic 2:

Coefficients:
                                   Estimate Std. Error t value Pr(>|t|)   
(Intercept)                       0.1275167  0.0396214   3.218   0.0015 **
incomeBetween $25,000 and $34,999 0.0002471  0.0725567   0.003   0.9973   
incomeBetween $35,000 and $49,999 0.0396425  0.0607230   0.653   0.5146   
incomeBetween $50,000 and $99,999 0.0610508  0.0530778   1.150   0.2514   
incomeOver $250,000               0.0314597  0.1103214   0.285   0.7758   
incomeUnder $25,000               0.1137905  0.0774979   1.468   0.1435   
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1


Topic 3:

Coefficients:
                                  Estimate Std. Error t value Pr(>|t|)    
(Intercept)                        0.19625    0.03717   5.280 3.25e-07 ***
incomeBetween $25,000 and $34,999  0.01663    0.07021   0.237    0.813    
incomeBetween $35,000 and $49,999  0.08167    0.06335   1.289    0.199    
incomeBetween $50,000 and $99,999  0.00631    0.04795   0.132    0.895    
incomeOver $250,000                0.15149    0.11020   1.375    0.171    
incomeUnder $25,000                0.04267    0.06793   0.628    0.531    
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1


Topic 4:

Coefficients:
                                   Estimate Std. Error t value Pr(>|t|)    
(Intercept)                        0.158981   0.038940   4.083 6.35e-05 ***
incomeBetween $25,000 and $34,999  0.005413   0.074508   0.073    0.942    
incomeBetween $35,000 and $49,999 -0.047180   0.060914  -0.775    0.439    
incomeBetween $50,000 and $99,999  0.054605   0.051622   1.058    0.291    
incomeOver $250,000               -0.061632   0.111796  -0.551    0.582    
incomeUnder $25,000               -0.060239   0.063605  -0.947    0.345    
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1


Topic 5:

Coefficients:
                                  Estimate Std. Error t value Pr(>|t|)    
(Intercept)                        0.30094    0.04604   6.537 4.77e-10 ***
incomeBetween $25,000 and $34,999 -0.03932    0.08327  -0.472    0.637    
incomeBetween $35,000 and $49,999 -0.06235    0.07328  -0.851    0.396    
incomeBetween $50,000 and $99,999 -0.09631    0.06193  -1.555    0.121    
incomeOver $250,000               -0.07263    0.12620  -0.576    0.566    
incomeUnder $25,000               -0.07602    0.07886  -0.964    0.336    
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Code
# estimate effects of ZIP Code
zip_effects <- estimateEffect(formula = 1:k ~ zip,
                               stmobj = stm_change,
                               metadata = CFA_tidy_2)

# get summary
summary(zip_effects)

Call:
estimateEffect(formula = 1:k ~ zip, stmobj = stm_change, metadata = CFA_tidy_2)


Topic 1:

Coefficients:
            Estimate Std. Error t value Pr(>|t|)  
(Intercept)  0.04786    0.23137   0.207   0.8363  
zip59801     0.16868    0.23260   0.725   0.4692  
zip59802     0.10542    0.23225   0.454   0.6504  
zip59803     0.06450    0.23669   0.273   0.7855  
zip59804     0.39097    0.25215   1.551   0.1226  
zip59808     0.14024    0.24130   0.581   0.5618  
zip59821     0.07121    0.36099   0.197   0.8438  
zip59823     0.30359    0.26190   1.159   0.2478  
zip59825     0.13708    0.26029   0.527   0.5990  
zip59826     0.55927    0.40631   1.376   0.1702  
zip59833     0.18341    0.29741   0.617   0.5381  
zip59846     0.07195    0.33489   0.215   0.8301  
zip59847     0.07692    0.25918   0.297   0.7669  
zip59860    -0.02422    0.32294  -0.075   0.9403  
zip59864     0.59609    0.38994   1.529   0.1280  
zip59868     0.11624    0.35782   0.325   0.7456  
zip59908     0.84501    0.33656   2.511   0.0129 *
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1


Topic 2:

Coefficients:
            Estimate Std. Error t value Pr(>|t|)  
(Intercept)   0.8387     0.3343   2.509   0.0129 *
zip59801     -0.6419     0.3338  -1.923   0.0559 .
zip59802     -0.7037     0.3324  -2.117   0.0355 *
zip59803     -0.6122     0.3486  -1.756   0.0806 .
zip59804     -0.6892     0.3480  -1.980   0.0491 *
zip59808     -0.7253     0.3401  -2.132   0.0342 *
zip59821     -0.8260     0.4326  -1.909   0.0577 .
zip59823     -0.5026     0.3591  -1.400   0.1632  
zip59825     -0.5461     0.3721  -1.468   0.1438  
zip59826     -0.5942     0.4894  -1.214   0.2261  
zip59833     -0.7886     0.3849  -2.049   0.0418 *
zip59846     -0.7977     0.4407  -1.810   0.0718 .
zip59847     -0.7608     0.3503  -2.172   0.0310 *
zip59860     -0.8336     0.4258  -1.958   0.0517 .
zip59864     -0.7987     0.4380  -1.824   0.0697 .
zip59868     -0.8309     0.4293  -1.936   0.0544 .
zip59908     -0.8236     0.4277  -1.926   0.0556 .
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1


Topic 3:

Coefficients:
             Estimate Std. Error t value Pr(>|t|)
(Intercept)  0.054642   0.261012   0.209    0.834
zip59801     0.158659   0.264123   0.601    0.549
zip59802     0.192080   0.262144   0.733    0.465
zip59803     0.204604   0.271221   0.754    0.452
zip59804     0.085207   0.273207   0.312    0.755
zip59808     0.228361   0.269399   0.848    0.398
zip59821    -0.038907   0.365350  -0.106    0.915
zip59823     0.116654   0.287839   0.405    0.686
zip59825     0.170334   0.299036   0.570    0.570
zip59826     0.004978   0.370878   0.013    0.989
zip59833     0.412447   0.328869   1.254    0.211
zip59846     0.590087   0.383418   1.539    0.125
zip59847     0.202356   0.290151   0.697    0.486
zip59860     0.029166   0.364310   0.080    0.936
zip59864     0.027134   0.369502   0.073    0.942
zip59868     0.197009   0.424037   0.465    0.643
zip59908    -0.020580   0.366634  -0.056    0.955


Topic 4:

Coefficients:
             Estimate Std. Error t value Pr(>|t|)  
(Intercept)  0.042778   0.260329   0.164   0.8696  
zip59801     0.144437   0.260792   0.554   0.5803  
zip59802     0.096848   0.264349   0.366   0.7145  
zip59803     0.071826   0.269977   0.266   0.7905  
zip59804     0.053355   0.274894   0.194   0.8463  
zip59808     0.056534   0.268183   0.211   0.8333  
zip59821     0.753220   0.399548   1.885   0.0609 .
zip59823     0.009218   0.287808   0.032   0.9745  
zip59825     0.176594   0.293586   0.602   0.5482  
zip59826     0.026547   0.372542   0.071   0.9433  
zip59833     0.085379   0.337101   0.253   0.8003  
zip59846    -0.024108   0.358635  -0.067   0.9465  
zip59847     0.266370   0.298730   0.892   0.3737  
zip59860     0.015152   0.378481   0.040   0.9681  
zip59864     0.069680   0.375566   0.186   0.8530  
zip59868    -0.009627   0.359067  -0.027   0.9786  
zip59908    -0.008059   0.359995  -0.022   0.9822  
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1


Topic 5:

Coefficients:
            Estimate Std. Error t value Pr(>|t|)  
(Intercept) 0.015739   0.290036   0.054   0.9568  
zip59801    0.170499   0.291528   0.585   0.5593  
zip59802    0.310772   0.292193   1.064   0.2888  
zip59803    0.271571   0.301134   0.902   0.3683  
zip59804    0.156567   0.308156   0.508   0.6120  
zip59808    0.301307   0.301814   0.998   0.3193  
zip59821    0.036289   0.411887   0.088   0.9299  
zip59823    0.073325   0.319813   0.229   0.8189  
zip59825    0.060166   0.331664   0.181   0.8562  
zip59826    0.003572   0.408674   0.009   0.9930  
zip59833    0.108267   0.368802   0.294   0.7694  
zip59846    0.147056   0.434504   0.338   0.7354  
zip59847    0.212568   0.336875   0.631   0.5288  
zip59860    0.816065   0.438273   1.862   0.0641 .
zip59864    0.109017   0.433597   0.251   0.8017  
zip59868    0.526910   0.465019   1.133   0.2586  
zip59908    0.008329   0.410320   0.020   0.9838  
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

It appears that each income bracket is slightly positively or negatively associated with each of the five topics but that none of these associations are statistically significant. There are some statistically significant associations between some of the ZIP Codes and particular topics. However, given that I am still exploring how to preprocess my corpus into a DFM and the appropriate number of topics, I am not considering this analysis to be final. Ultimately, the sample is such (too small, not distributed over income brackets and ZIP Codes–some of the ZIP Codes have one respondent!) that it will preclude me from drawing any firm conclusions about associations anyway.

Challenges and Questions Moving Forward

One challenge with topic modeling is that it is up to the researcher to decide how many topics (k) to include in the model. I have no sense of how to do this. Given that the corpus I am working with right now is only a few hundred short documents, I could count them manually but that will not always be feasible. It seems that the best practice is to build models with several different values for k and use various methods to evaluate those models.

In addition to thinking about how to tweak my DFM to make the results of my analysis more revealing, I also need to learn how to evaluate my models to determine which is the most appropriate. Related to that, I need to figure out how to visualize my results.