We Used It The Way We Wanted To - Research on Learner Engagement in Participatory Learning Environments
X
"We used it the way we wanted to": Research on Learner Self-Engagement in Web 2.0 Participatory Environments
About Us
Background
Participatory Media?
Old School Ed. Perspectives
More Recent Research
pMedia for Education
Existing Literature
Research: Blogs (+)
Research: Blogs (-)
Other Tools
Summary
Our Research
Our Research
Our Research Avoids
Social Media Classroom
Howard’s Course
Social Media Classroom
Howard’s Course
Reality Check
Back to Our Research
Methods
Discussion of Findings
pMedia for Education
No “one-tool-fits-all”
Instructor Influence
Other Influences
Self-Directed Learning
Learning Activities
Learning Activity Focus
Challenges / Takeaways
Learning Activity Focus
Challenges / Takeaways
Conclusions and Next Steps
Preliminary Conclusions
Preliminary Recommendations
Implications, Future Research
Thank You!
00:00
/
00:00
CC
Deborah
Everhart
&
Erin
Knight
http://www.flickr.com/photos/nswlearnscope/2053289691/
Dr.
Deborah
Everhart
Adjunct
Assistant
Professor,
Georgetown
University
Chief
Architect,
Blackboard
Inc.
Research
Associate,
Blackboard
Institute
Erin
Knight
Research
Director
Center
for
Next
Generation
Teaching
and
Learning
School
of
Information,
UC
Berkeley
http://www.flickr.com/photos/nswlearnscope/2053289691/
Social
media,
Web
2.0,
“pMedia”
Tools
that
foster
participation
online
Blogs,
wikis,
forums,
chat,
social
bookmarking,
social
networking
Key
Principles:
-
network
effects
-
low
barrier
to
entry
-
rich
user
experiences
-
openness
http://www.flickr.com/photos/exlibris/2221270885/
Piaget:
Constructivism
(1920s)
Vygotsky:
Social
Constructivism,
Zone
of
Proximal
Development
(1920s)
Papert:
Constructivism
and
computers
(1970s)
http://www.flickr.com/photos/51035821186@N01/2645006348/
Distance
education
Human
motivation
Learning
sciences
Brain-based
research
http://www.flickr.com/photos/91499534@N00/466547709/
Learners
learn
more
when
they
can
socially
construct
their
understanding.
Student-centered
learning
environments
can
facilitate
deeper
learning
than
teacher-centered
approaches.
Participatory
media
can
be
used
to
foster
student-centered
and
socially
constructed
learning.
Key
Assumptions:
http://lowery.tamu.edu/Teaming/Morgan1/sld023.htm
Emerging,
inconclusive
Tool-focused,
typically
a
single-tool
Attempts
to
prove
“effectiveness”
or
profess
“The
Right
Way”
to
use
the
tool
Contextually
bound,
often
not
generalizable
http://www.flickr.com/photos/jannem/3312116875/
effective
interactive
knowledge-exchange
tools
support
unique
voices
empower
learners
to
assert
their
ideas
and
opinions
encouraging
to
think
critically
foster
reflection,
facilitate
deeper
connection
richer
understanding
due
to
hyperlinks,
contextual
information
and
revisiting
concepts
(Herring
et
al.,
2004;
Oravec,
2002;
Ferdig
&
Trammel,
2004,
Koschmann
at
al.,
1996)
benefits
not
same
for
all
users
open
nature
can
intimidate
learners
and
discourage
use
must
be
kept
active
and
maintained
require
a
high
level
of
learner
and
instructor
motivation
to
participate
(Saeed
et
al.,
2008;
Raymond
Tri-Dang
Firpo
et
al.,
2009;
Mason
&
Rennie,
2008)
Chat
Forums
Wikis
Social
Bookmarking
Research
is
not
broadly
conclusive
Too
tool-focused
Learning
environments
are
nuanced!
Need
to
step
back,
get
broader
understandings
of
use,
perceptions,
motivations,
etc.
http://www.flickr.com/photos/fatboyke/2668411239/
http://www.flickr.com/photos/nswlearnscope/2053289691/
Observe
usage
across
many
tools,
across
courses
Explore
the
complexities
and
nuances
within
each
learning
environment
Discover
trends
or
patterns
across
courses
Understand
student
and
instructor
perceptions,
expectations
and
motivations
Inform
future
research
http://www.flickr.com/photos/11445550@N00/986296861/
Claiming
effectiveness
Implying
that
different
types
or
levels
of
use
are
necessarily
better
Assuming
that
patterns
of
use
in
these
environments
are
applicable
to
different
environments
http://www.flickr.com/photos/11445550@N00/986296813/
“SMC”
Open
source
course
site
solution
built
around
embedded
social
media
tools
Originally
developed
by
Howard
Rheingold,
adapted
by
I
School
Early
adoption
=
unique
opportunity
to
observe
usage
across
courses
and
interview
instructors
and
students
Developed
the
SMC
to
support
his
own
course
on
digital
media
Taught
the
course
9
times
now
Claims
he
finally
has
“gotten
it
right”,
although
continues
to
innovate
Tells
students
upfront
that
usage
is
required
Also
tells
them
the
type
of
use
expected
in
each
tool
Screenshot
from
Howard’s
Course
“SMC”
Open
source
course
site
solution
built
around
embedded
social
media
tools
Originally
developed
by
Howard
Rheingold,
adapted
by
I
School
Early
adoption
=
unique
opportunity
to
observe
usage
across
courses
and
interview
instructors
and
students
Developed
the
SMC
to
support
his
own
course
on
digital
media
Taught
the
course
9
times
now
Claims
he
finally
has
“gotten
it
right”,
although
continues
to
innovate
Tells
students
upfront
that
usage
is
required
Also
tells
them
the
type
of
use
expected
in
each
tool
Screenshot
from
Howard’s
Course
Most
instructors
are
not
Howard
Many
are
using
technology
or
social
media
for
the
first
time
Most
cannot
take
as
many
risks
Most
do
not
have
the
time
to
do
trial-and-error
Not
all
course
content
has
such
as
direct
tie
to
the
tools
Adapted
from:
http://www.flickr.com/photos/intenteffect/4263014185/
Instructors
were
first
time
users
of
these
tools
All
early
adopters
of
the
SMC
in
the
2009-2010
school
year
It
is
important
to
understand
these
newer,
‘messier’,
perhaps
more
common
environments
Observation
of
usage
patterns
in
4
courses
using
the
SMC
(8
instructors,
150
students)
Pre/Post
surveys
on
expectations
and
perspectives
(79/73
Pre/Post
responses)
Student
interviews
Faculty
interviews
http://www.flickr.com/photos/smiling_da_vinci/14785644/
http://www.flickr.com/photos/nswlearnscope/2053289691/
Learners
learn
more
when
they
can
socially
construct
their
understanding.
Student-centered
learning
environments
can
facilitate
deeper
learning
than
teacher-centered
approaches.
Participatory
media
can
be
used
to
foster
thestudent-centered
and
socially
constructed
learning.
KEY
ASSUMPTIONS:
?
?
?
http://lowery.tamu.edu/Teaming/Morgan1/sld023.htm
Each
course
used
the
SMC
differently
Usage
was
focused
around
one
tool
and
that
tool
differed
across
courses
Instructors
used
the
tools
differently
Differences
in
use
across
students
within
a
course
Many
different
types
of
influence
Course
Tool
Used
Course
1
Blog
Course
2
Wiki
Course
3
Blog
Course
4
Forums
Directives
-
instructions,
modeling
Participation
-
instructor
posts
or
comments
Grading
-
grading
usage
on
the
site
“I
commented
on
posts.
I
made
blog
posts.
That's
important
because
it
let’s
them
know
that
I
read
them
and
you
have
to
be
credible.”
ASSIGNMENT
#1:
1.
Find
a
news
story
2.
Blog
about
it
and
tag
it
3.
Add
the
link
as
a
Social
Bookmark
and
tag
it
Course
Attributes
Social
Norms
Student
Familiarity
or
Preference
Interplay
between!!
“It’s
a
different
style
of
reading...At
some
point
I
have
to
be
like,
I
cannot
spend
anymore
time
on
this
class.
”
“I
felt
like
the
concepts
were
more
difficult
to
grasp
in
Course
1
and
lent
themselves
more
to
discussions
and
stories
on
the
blog.”
“Since
no
one
was
using
it,
I
didn't
use
it.
You
don't
want
to
waste
your
time
writing
something
that
no
one
is
going
to
look
at.”
“Blogging
is
something
I
do
anyway
so
it’s
just
a
natural
form
for
me
to
kick
around
ideas.”
In
some
cases,
students
‘took
over’
tool
Used
it
to
self-direct
learning
Extremely
valuable
observation
to
explore
further
“Once
it
became
a
habit,
no
grading
incentives
were
needed.”
“Since
it
wasn't
clear
about
how
we
needed
to
use
it
or
if
it
was
graded,
we
used
it
the
way
that
we
wanted
to.”
“I
think
the
more
that
I
would
go
in
there
and
read
the
posts
and
try
to
put
in
my
own
two
cents,
the
more
I
liked
it
and
the
more
I
wanted
to
use
it.
”
Much
of
existing
literature
is
tool-focused
Align
certain
learning
activities
with
certain
tools
We
saw
each
tool
used
for
wide
range
of
learning
activities
No
“one-use-fits-each-tool”
Convergence
of
tools
OR
evidence
of
student’s
adapting
tool
to
their
needs
Call
for
switch
of
focus
Start
with
underlying
goal
or
objective,
then
apply
technology
Multiple
tools
could
do
the
job
Easier
for
instructors
to
approach,
integrate,
evaluate
Students
struggled
with
work-load
balance
Instructors
faced
many
social,
pedagogical
and
technical
challenges
Were
able
to
overcome
social
and
pedagogical,
but
technical
was
a
show
stopper
Instructors
said
that
they
would
use
the
system
again,
but
with
adaptations
“Some
call
it
‘fun'
and
it’s
like,
no
it’s
actually
work.
Staying
on
top
of
what
people
are
posting,
commenting
and
finding
your
own
stuff
is
actually
a
lot
of
work.”
I
haven’t
used
it
much
because
I
hate
passwords,
and
I
forget
them
and
cannot
access
the
site.
I
would
devote
15
minutes
of
each
lecture
to
talk
about
the
blog.
That
says:
I
did
read
this
stuff,
I’m
going
to
give
you
credit
for
figuring
out
a
good
thing,
and
I’ll
give
you
some
air
time.
Call
for
switch
of
focus
Start
with
underlying
goal
or
objective,
then
apply
technology
Multiple
tools
could
do
the
job
Easier
for
instructors
to
approach,
integrate,
evaluate
Students
struggled
with
work-load
balance
Instructors
faced
many
social,
pedagogical
and
technical
challenges
Were
able
to
overcome
social
and
pedagogical,
but
technical
was
a
show
stopper
Instructors
said
that
they
would
use
the
system
again,
but
with
adaptations
“Some
call
it
‘fun'
and
it’s
like,
no
it’s
actually
work.
Staying
on
top
of
what
people
are
posting,
commenting
and
finding
your
own
stuff
is
actually
a
lot
of
work.”
I
haven’t
used
it
much
because
I
hate
passwords,
and
I
forget
them
and
cannot
access
the
site.
I
would
devote
15
minutes
of
each
lecture
to
talk
about
the
blog.
That
says:
I
did
read
this
stuff,
I’m
going
to
give
you
credit
for
figuring
out
a
good
thing,
and
I’ll
give
you
some
air
time.
http://www.flickr.com/photos/nswlearnscope/2053289691/
Learner-centered
approach
is
important
to
most,
but
an
adjustment
for
many
Learning
environments
are
nuanced
social
systems
Activities
and
adoption
vary
among
courses
Many
factors
can
influence
use
In
some
cases,
learners
can
use
the
tool(s)
to
self-direct
learning
Tools
can
support
many
different
learning
activities
.
”
“
Lead
with
the
learning
activity
or
goal
first,
then
apply
technology
Provide
“self-service”
pMedia
in
courses
where
collaborative
activities
may
or
may
not
be
scaffolded
-
Always
on
-
Easy
to
access
from
other
online
course
materials
-
Notifications
with
RSS
or
other
feeds
for
quick
attention
Scaffold
use
of
pMedia
outside
of
courses
to
provide
models
and
set
expectations
for
use
within
courses
-
Include
in
orientation,
intro
courses,
other
required
activities
-
Structure
learning
cohorts
-
Teach
pMedia
“rules
of
engagement”
and
leadership
skills
Facilitate
community-building
-
Require
identity
(name
and
avatar,
not
anonymous)
-
Allow
commenting
-
Continue
participation
after
and
across
courses
Observe
more
courses,
conduct
interviews
with
more
students
and
instructors,
broaden
survey
results
Map
learning
activities
to
learners’
tool
choices
Analyze
interplay
and
weighting
of
varying
influences
on
use
Illuminate
motivations
and
factors
behind
self-directed
learning
Investigate
social
issues
(privacy,
identity,
ongoing
relationships,
etc.)
Observe
use
of
other
participatory
tools
(video,
mind
maps,
etc.)
http://www.flickr.com/photos/cdm/54246114/
Center
for
Next
Generation
Teaching
and
Learning:http://ngtl.ischool.berkeley.edu
Blackboard
Institute:
http://blackboardinstitute.com/
Contribute
to
the
next
phase
of
research:
http://ngtl.ischool.berkeley.edu/learner-engagement
eknight@ischool.berkeley.edudeverhart@blackboard.com
.
.
.
.
the
shining
as
a
.
I
mean
is
there
are
can
inherent
in
wearing
the
hats
women
and
ten
Assistant
Professor
Georgetown
University
right
Teaching
the
city's
Department
.
Steve
Architect
apply
for
and
product
management
strategy
that
primary
here
today
and
why
has
the
research
is
to
see
at
the
blackboardinstitute
.
you're
not
really
in
sixteen
.
it's
a
non-profit
arm
up
for
any
race
with
others
around
the
world
research
projects
like
this
with
Erin
Knight
.
he's
Research
Director
Center
for
Next
Generation
Teaching
and
Learning
School
of
Information
UC
Berkeley
.
How
does
present
a
serious
technology
at
stake
it's
not
just
on
Blackboard
in
fact
he
probably
won't
care
Blackboard
during
unrest
in
its
present
age
.
it's
show
background
time
Texas
jury
media
.
we
needed
by
preferred
media
or
the
media
for
sure
.
part
in
the
air
.
the
No
.
Web
two
point
air
Social
Media
and
collaboration
on
why
this
is
handset
twenty
nine
ERA
.
on
E
and
to
give
readers
to
write
any
of
tools
in
the
context
of
this
research
project
only
tools
they
use
for
learning
collaboration
.
live
to
be
using
Alliance
are
commonly
associated
with
plenty
of
blame
to
by
were
also
in
creating
discussion
forums
and
chat
in
and
that
a
carrier
has
said
research
means
for
word
for
looking
at
ways
that
they're
seeing
her
and
schools
can
be
in
steering
chance
for
engagement
.
our
presence
awareness
.
he
and
other
ways
for
students
do
you
find
and
engagement
on
the
other
.
cs
.
this
life
because
it
is
important
now
that
the
principles
the
high
using
these
tools
are
not
new
to
take
a
solid
body
of
early
twentieth
century
research
begins
as
a
framework
for
investigation
.
and
more
recently
sc
on
areas
of
study
that
is
a
very
specific
and
that
can
be
WHY
to
lead
to
higher
tolls
.
we
sometimes
hear
present
a
centered
people
are
talking
at
these
tools
can
have
a
the
news
is
if
this
is
just
sprung
up
by
now
where
in
fact
there's
a
lack
of
work
it's
are
you
contending
the
serious
they
can
be
useful
a
apply
.
Sweeney
Research
Distance
said
get
back
to
these
forty
years
in
creating
a
lot
in
the
search
stand
by
and
see
researchers
.
I
was
talking
to
someone
at
the
conference
last
month
.
he
pointed
out
correctly
that
.
so
things
they
were
looking
at
in
terms
of
free
samples
team
motivation
where
things
that
Distance
and
researchers
are
looking
at
twenty
years
ago
because
he
the
words
heating
up
Pre
based
Distance
education
he
needed
to
hear
our
house
Tuesday
be
motivated
to
work
on
around
email
things
back
and
try
instructors
to
provide
timely
feedback
where
timely
in
that
context
actually
had
some
other
more
serious
limitations
.
again
the
point
being
that
.
Distance
education
gives
us
the
game
.
grounding
inside
with
characters
that
were
looking
at
today
.
the
social
sciences
give
us
did
studies
for
example
and
healing
motivations
can
get
my
not
necessarily
be
him
nation
and
Learning
at
studies
that
can
indicate
how
learning
environments
can
be
impacted
by
.
other
factors
in
terms
of
what
motivate
people
.
and
then
the
growing
strain
audio
Learning
Sciences
Research
is
brilliant
said
.
ten
solid
studies
of
how
people
learn
why
they
learned
.
but
states
have
to
be
Applied
Center
which
is
actual
Brain
based
research
that
looks
at
the
Chemistry
of
what's
happening
in
someone's
brain
when
their
learning
.
I
mean
these
are
current
Sciences
said
he
knew
things
that
.
given
the
opportunity
.
see
you
.
and
Billy
seems
learning
based
on
and
more
knowledge
than
we
ever
had
before
.
show
.
this
is
why
.
there
is
a
comeback
in
a
few
minutes
when
she's
talking
about
research
results
anywhere
like
to
make
here
.
in
terms
the
context
of
research
is
that
there
is
a
body
Research
.
it's
all
is
it
that
our
retention
improved
learning
at
times
can
be
a
stay
sixty
three
a
more
active
learning
processes
.
said
are
scenes
needs
U
WIRE
twenty
first
Century
Learning
skills
in
terms
and
how
they
can
actively
can
seem
information
how
they
can
collaborating
with
others
in
making
the
need
of
having
conceded
deeper
understanding
that
acceptable
to
various
circumstances
.
and
.
he
process
is
highly
it's
we
Teaching
it
seems
opportunities
to
learn
actually
do
have
an
impact
on
the
series
after
Practices
surveying
activities
that
are
not
just
instructors
lecturing
and
Steve's
passively
listening
that
does
make
a
difference
in
learning
.
we'll
see
when
Aaron
present
the
research
with
all
this
research
project
is
not
the
as
I
mentioned
our
terms
.
it's
a
Zune
more
general
bowler
discovering
a
boxing
the
conditions
that
lead
to
Learner
stopper
Gates
.
based
on
a
promise
that
that
so
engaged
and
will
inter
the
students
other
than
that
and
the
thousands
.
the
CSS
and
gusty
research
that
you
do
not
technology
driven
.
that
and
then
by
these
key
ASSUMPTIONS
.
cs
.
so
in
answer
their
existing
Literature
honors
found
that
most
of
the
research
on
these
key
media
tools
and
technology
focused
on
and
gets
.
users
that
a
seventy
and
justify
the
use
of
a
specific
technology
school
.
meetings
that
demonstrate
return
on
that
twenty
BST
than
they
to
convince
Faculty
to
use
it
School
.
cases
of
research
is
based
on
trying
team
and
I
team
a
call
Friday
.
way
to
use
a
specific
technology
.
I'm
these
research
projects
are
done
in
Structure
and
Kerman
.
where
have
we
Scaffold
it
activities
.
can
this
research
is
generally
not
focused
on
Learner
perspective
is
not
a
time
nasty
realistic
situation
that
we
are
really
know
how
to
use
the
technology
effectively
and
are
giving
themselves
are
getting
just
use
any
guidance
on
how
to
use
a
technology
effectively
.
because
well
that
that's
Nancy
that's
not
the
way
someone
wants
to
do
you
Research
in
yet
we
know
that
that
it
eighty
percent
of
the
Faculty
.
major
League
adopters
are
in
laggards
.
and
despite
the
best
intentions
probably
do
not
know
how
to
use
these
more
progressive
technologies
in
ways
that
actually
benefit
their
students
.
and
we
look
at
in
these
areas
should
actively
.
there
is
also
this
summer
and
the
advantages
that
using
these
tools
are
all
said
it
Disadvantages
.
so
we
actually
have
a
great
deal
or
game
that
are
stand
How
and
why
manage
use
these
tools
in
ways
to
capitalize
on
it
that
this
and
avoid
the
cost
.
is
no
surprise
that
these
P
media
learning
activities
are
unhappy
but
a
complex
social
and
personal
aspects
that
collaborative
learning
activities
kids
.
classes
in
groups
of
learners
.
the
class
with
you
know
classes
are
diverse
and
they
have
a
variety
of
personalities
and
objectives
that
they
planning
to
be
to
the
learning
environment
.
to
me
the
advantage
Disadvantages
for
example
.
why
can't
our
learners
to
assert
their
ideas
and
opinions
cs
.
Advantages
often
lead
Disadvantages
to
get
some
learners
insurgents
can
intimidate
others
and
in
the
Senate
will
be
discouraging
using
lot
.
to
the
complexities
are
compounded
by
carrying
students
in
now
on
the
learning
styles
and
these
are
areas
that
need
further
exploration
.
I'm
counting
Research
.
Summary
Evans
told
both
demonstrate
the
advantages
and
disadvantages
on
where
that
stands
in
to
CNN
said
.
it's
a
crying
.
down
the
house
seems
use
these
tools
and
a
and
that
his
own
despite
the
disadvantage
is
very
easy
in
some
really
surprising
ways
.
Summary
We
think
this
deal
questions
as
an
opportunity
to
step
back
and
server
uses
the
PBA
in
courses
at
her
variable
and
nasty
attacks
.
very
different
levels
of
scaffolding
for
how
users
were
expected
to
use
key
meeting
its
goals
in
their
learning
activities
.
design
researchers
are
yellow
centered
promising
results
particularly
with
regard
to
understanding
Learner
motivations
and
so
engaged
in
is
that
as
and
will
now
Explain
and
Martell
.
.
I
.
I
mean
is
that
after
the
three
.
shares
in
any
numbers
out
this
loan
.
easy
for
me
.
that
mentioned
just
the
initial
phases
of
study
that
are
conducting
a
.
actually
it
an
immediate
results
.
Tennessee
Expert
race
anyhow
least
for
the
ongoing
research
projects
which
were
in
How
Illuminate
a
.
yes
.
faced
with
a
team
that
usage
fees
for
and
that
teach
critical
and
he
looked
into
his
decision
yet
.
just
one
goal
and
one
context
we
are
at
peace
to
all
people
are
reading
across
courses
which
again
you
would
expect
to
be
different
because
of
these
complexities
and
nuances
of
the
site
.
the
agency
and
he
usage
trends
or
patterns
emerged
across
courses
.
meanwhile
the
differences
were
.
on
his
way
not
only
how
instructors
scenes
he
took
full
Editing
I
that
ready
for
use
to
be
treated
deeper
and
get
instructor
and
she
perceptions
motivations
expectations
.
thousand
and
I'll
make
a
list
are
really
hit
the
top
Abbas
on
Saturday
better
understand
what's
going
on
in
space
.
and
then
highway
there
is
for
future
research
.
yes
.
for
twenty
making
Claims
Act
.
Serwer
not
saying
it's
a
deadlock
there
.
the
period
or
the
labs
are
more
affected
than
for
its
.
also
tentatively
Implying
that
tired
of
the
piece
that
will
be
different
a
user
necessary
.
Saxton
Wolf
.
you've
seen
some
buses
and
assess
the
quality
over
quantity
so
it's
this
case
you
really
decided
she
s
differences
.
judge
media
.
we're
not
trying
to
get
either
a
standard
.
it's
become
very
we
can
.
just
before
the
user
which
broke
.
the
SMC
.
courses
at
the
scene
are
we
.
yes
and
seizing
of
interest
or
site
solution
built
on
top
Kimball
and
built
around
embedded
.
he
tools
.
we
Each
.
tool
.
the
SMC
was
returning
to
Not
car
and
go
and
serve
we
all
know
but
can
she
do
.
and
here
in
the
Adobe
Angeles
.
you
have
a
Social
Media
Classroom
built
into
the
is
the
public
and
he
presented
to
you
.
UC
Berkeley
faculty
.
or
was
there
last
year
.
he
has
is
that
yes
he
was
the
first
time
Instructors
says
he
really
is
yes
he
is
or
how
he's
across
courses
but
it's
really
a
doctor's
and
US
teams
react
to
a
music
in
the
last
thing
.
How
has
the
SMC
and
he
actually
develop
this
is
where
the
numbers
don't
Media
City
uses
the
session
mediated
Teaching
message
here
.
words
many
times
in
usage
.
the
interactions
any
claims
that
he's
friendly
gotten
great
pitching
the
defense
team
is
made
.
well
yes
.
interaction
.
Rusty
evaluations
.
you're
.
the
tool
and
you
tool
.
so
it
is
definitely
at
the
far
end
of
the
Continue
.
and
instructor
stepping
piece
tools
.
again
he's
resigned
as
he's
ever
time
he
turned
and
testing
and
things
discuss
discussing
don't
work
.
he's
a
really
will
you
and
take
those
risks
.
the
last
and
he
still
seems
upfront
that
there's
a
show
here
.
why
.
they're
talented
they
received
the
worst
.
one
thing
he's
Effects
with
the
needs
to
answer
to
that
defiance
.
it's
a
breach
tool
to
why
he
the
bloggers
.
yell
at
me
.
Danny
any
kind
testing
its
lead
to
a
new
Moneyline
for
Tuesday
see
that
happening
for
five
years
.
and
tools
a
very
actively
consistently
use
across
the
tool
of
the
Prophet
students
in
each
tool
.
this
is
the
best
.
the
yen
.
now
another
key
is
of
interest
.
he
is
an
exciting
ads
.
words
billion
or
.
How
are
in
a
time
when
the
lecture
each
of
the
uneasy
tools
to
China
especially
many
of
them
I
say
that
they'll
take
these
risks
.
maybe
maybe
you
can
in
the
first
time
.
for
many
many
times
in
Sudan
is
doing
I
mean
things
were
.
and
courses
are
really
does
not
address
the
media
.
anywhere
is
a
lot
teach
about
wanting
for
him
.
well
they
may
be
less
clear
to
know
anything
tools
for
to
teach
calculus
.
the
connection
is
not
always
as
direct
.
did
you
mean
Faculty
.
interesting
it
waste
usage
of
the
a
course
.
the
average
means
users
are
totally
doesn't
know
permanently
to
scare
and
had
attended
the
hearing
.
ABB
dealer
dots
.
early
on
that
.
tools
.
Bruno
is
the
answer
usage
this
new
feature
sure
coaching
them
.
the
first
clear
Pre
and
Perkins
.
he's
messier
and
red
means
there
probably
actually
the
communist
state's
racing
tool
site
.
the
NAR
the
medial
to
allow
elections
in
states
that
are
understand
that
it's
program
.
and
again
is
actually
delivered
this
didn't
use
interaction
usage
or
where
he
it
was
not
to
lose
.
so
the
observed
that
the
usage
of
the
SMC
and
or
purses
.
when
Stanley
instructors
and
students
.
the
Korean
go
surveys
to
get
expectations
for
stack
its
citation
the
state
of
Pakistan
.
he
retires
.
we
can
use
.
Plays
of
the
Final
four
.
outlining
the
key
ASSUMPTIONS
and
are
just
the
idea
of
just
three
defeats
.
I
mean
thousand
or
three
new
substance
.
socially
construct
their
understanding
.
and
then
using
heavy
concrete
examples
of
what
intrigues
their
first
then
help
them
connect
.
police
said
the
other
scenes
perspectives
interpretations
increase
the
overall
understanding
.
area
.
and
the
Examples
.
well
as
a
students
that
their
name
and
using
it
.
and
that
it
will
it
.
yes
.
there
is
actually
completely
doing
so
it's
intended
right
.
the
Senate
to
take
interesting
because
his
teachings
were
all
there
.
that
was
once
to
restate
the
scientists
knew
current
time
.
interaction
thestudent
about
this
.
.
Cincinnati
is
a
good
thing
we
learned
that
interaction
.
Unique
the
firm's
deal
with
that
.
he's
out
there
as
well
as
entertains
me
to
get
interpretations
of
their
seats
.
many
leading
receiver
they
did
.
that
is
next
.
Presenters
and
radiation
gets
there
.
again
this
is
a
threat
and
the
refusing
to
use
the
various
states
.
however
users
of
.
four
.
it
certainly
has
the
STEM
concerning
the
differences
.
I
knew
my
Explorer
.
patients
also
have
a
complexities
and
using
these
tools
for
use
those
words
.
and
when
you
think
that
hundred
of
the
city
Literature
one
tool
.
it's
.
and
we're
courses
and
AIDS
are
always
SMC
very
different
.
in
the
eighty
four
even
though
all
schools
were
a
little
Usage
was
focused
around
.
courses
.
created
the
first
utility
in
Course
credit
for
.
use
the
tool
making
racist
discuss
the
science
.
he
said
that
to
many
different
ways
so
this
draft
.
Sharon
speaking
with
you
you
teach
orders
which
listening
creation
of
use
.
I
usage
that
we
compare
with
Dan
courses
today
Screenshot
are
seeing
there
for
the
last
this
scene
Vinatieri's
.
Taylor
use
a
very
few
people
in
.
and
more
workers
.
many
actually
the
courses
and
see
it
very
well
.
.
it
is
is
that
he
never
regained
How
am
I
of
course
is
surgery
is
at
Los
use
.
I
really
learning
take
a
few
well
Were
said
the
underlying
inspectors
to
search
growth
is
to
protect
use
of
use
.
the
latest
eye
in
the
sky
.
instructor
influence
to
the
meantime
as
these
tools
.
Arena
his
toes
here
you're
talking
about
.
instructor
.
these
are
three
ways
that
Instructors
influence
use
that
one
is
Directives
which
included
instructions
are
monitoring
the
use
each
tool
.
Morris
is
in
its
iTunes
there
anything
tool
in
the
blog
here
.
so
interfaces
occasion
to
say
that
I
could
do
that
by
the
actions
of
herself
a
common
scene
or
for
anti-U
.
the
scene
and
class
.
in
a
friendly
grading
taking
great
individual
posts
or
her
own
company
Overall
speech
gray
.
fill
in
Howard's
Course
is
the
best
of
the
second
day
trying
to
stay
.
versus
observed
that
there
are
much
fewer
often
consisted
and
did
not
seem
to
drastically
affect
the
overall
usage
.
.
Campbell
one
reading
one
words
one
strike
and
create
use
at
beginning
and
then
she
.
the
graded
on
opening
day
.
explicitly
said
that
it
was
graded
upfront
.
but
he's
different
.
Gerecht
It's
day
the
Usage
was
denied
Student
I
Directives
that
there
was
a
show
.
Slater
and
grading
not
to
race
.
and
since
you're
worried
about
new
industries
.
he
lives
this
time
.
the
defense
that
led
to
use
the
ministers
were
answered
when
rest
of
the
assignments
but
they
only
just
heard
sharing
it
tools
.
in
the
end
one
of
the
courses
that
actually
require
the
use
of
the
law
and
social
bookmarking
that
maybe
they've
ever
since
many
play
a
part
of
GM
isn't
over
.
and
while
the
law
Continue
Cha
Decision
of
use
.
so
again
he's
eleven
.
there
was
some
kids
have
made
enough
lg
to
tie
the
variety
Systems
up
seats
.
these
are
men
understand
our
managers
and
other
the
influence
use
but
.
England
has
no
new
console
.
yet
there
.
so
the
Influences
were
already
one
of
which
was
Course
action
he's
said
these
are
things
about
the
course
itself
but
said
it
selected
or
why
.
the
content
of
the
worst
of
it
chapter
by
.
they
can
use
these
kind
of
very
course
the
lead
themselves
smartest
you
discussions
that
.
there's
.
it
seems
that
the
focus
on
changing
the
that
really
comes
together
group
.
million
to
NT
use
the
Wiki
are
worse
.
he
will
give
you
the
level
are
now
pressuring
him
.
in
one
scene
.
Britain's
commenting
that
he
was
not
because
the
reading
and
courses
at
the
end
to
its
.
they
say
.
the
S
and
can
lead
to
scores
.
during
several
help
seventy
.
let
me
needs
to
stay
in
one
year
tours
because
there
is
no
letup
of
the
in
the
last
.
he
says
.
people
were
using
this
.
you'd
say
that
in
the
first
anyway
.
the
students
at
the
last
connection
to
.
because
in
the
last
in
the
class
.
he
was
the
deputy
to
the
course
itself
that
are
and
when
things
didn't
use
the
tool
.
the
market
play
.
one
of
the
numbers
Teaching
said
because
interact
with
the
man
or
another
question
about
whether
used
students
at
a
meeting
Friday
because
no
one
was
using
it
for
a
week
.
be
it
.
the
early
was
raised
the
bar
three
as
general
and
the
terrorists
doing
and
doing
it
this
way
.
million
dollars
in
Germany
or
the
it
was
a
major
energy
use
.
there's
ever
many
actually
that
it
Instructors
the
interesting
reading
.
one
is
in
very
serious
.
it
really
started
a
Barclays
daily
.
the
leaks
.
he
added
the
league's
bottom
is
and
then
wanted
to
see
people
ask
for
it
to
be
.
I
knew
that
she
is
a
twenty
in
the
number
and
recorded
a
search
used
for
.
including
the
recorded
messages
interesting
million
here
Preference
to
the
tools
and
some
scenes
were
more
familiar
have
a
particular
tool
sentenced
Wednesday
saying
I
want
to
say
.
King
things
around
.
I
have
level
of
for
the
detainees
and
whether
it's
a
or
your
reasoning
class
.
I
mean
you
know
there's
a
link
but
not
slated
to
enter
a
team
that
has
really
come
into
play
going
on
here
.
and
his
previously
discussed
that
are
not
intending
and
not
done
to
try
to
simplify
minimizing
the
role
the
way
to
accurately
measure
.
you
never
get
in
shape
.
s
.
and
you
know
the
during
the
essential
the
complexity
that
is
tool
and
instructors
and
students
.
happy
together
.
so
one
interesting
observation
that
the
murders
with
Advantages
teams
took
over
the
tool
use
up
your
way
.
many
teams
commenting
on
use
becoming
or
something
that
they
did
that
in
itself
.
now
who
are
there
many
.
he
said
he
had
the
surgery
not
clear
about
how
you
that
you
think
we
used
to
the
women
want
you
.
where
did
she
know
it
the
day
.
in
other
words
reading
a
statement
.
today
Advantages
is
worrying
instructors
.
the
Course
murky
here
interactive
budget
process
which
we
can
improve
things
.
and
then
every
day
later
things
that
they
.
them
and
he
is
a
question
Class
A
share
.
I
would
say
.
lent
is
a
.
you
are
great
.
and
then
the
more
limited
go
in
and
read
the
posts
and
try
to
manage
these
ads
.
you
didn't
have
lately
been
no
grading
people
are
meeting
with
veteran
of
the
original
thousand
twelve
.
and
yet
in
word
and
you
measure
all
is
interaction
about
a
threatening
situation
to
be
seen
just
answer
that
.
the
other
one
is
they
.
to
me
to
play
with
the
were
made
here
today
.
Bill
you
were
seeing
softer
they
are
sent
Reader
to
money
and
this
is
a
really
important
observation
.
especially
for
the
better
.
the
plant
.
the
news
really
readily
available
tool
Research
days
their
nations'
cetera
to
really
take
control
and
he
doing
there
.
the
survey
where
.
yes
.
.
he
still
has
to
imagine
activities
and
must
be
existing
measures
that
will
.
about
.
that's
a
huge
get
out
.
wind
and
then
that
means
you're
still
with
you
.
it's
that
Introduction
are
already
.
How
many
tools
at
the
country's
WHY
region
but
can
these
events
you've
been
so
.
this
charter
flight
here
in
gray
and
.
the
entity
to
be
a
reading
of
the
month
to
be
there
.
he
hit
every
time
I
fly
every
exhibit
which
are
about
.
I
heard
into
the
net
is
there
any
Error
Bridge
.
so
when
the
bottom
and
you
can
.
Claims
he
that
he
came
.
the
content
so
that
they
had
that
usage
is
rightfully
the
game
.
this
tool
they're
converging
.
tool
.
he's
.
it
is
not
about
acting
.
because
there's
not
a
capacity
to
come
.
next
to
the
eleventh
be
taking
many
using
the
tools
but
he
decisions
based
on
race
.
other
scenes
that
.
he
added
.
yet
another
exciting
.
it
will
cease
.
the
trial
attorney
.
twenty
yesterday
.
as
I
mentioned
he
did
typically
it's
a
very
tall
.
it
stands
at
him
.
first
we
actually
saw
the
eleventh
when
some
of
the
professors
there
are
viewed
in
the
interview
.
they're
using
these
tools
that
.
schools
in
a
record
eighty
of
them
and
eating
chad
.
and
so
I
think
probably
.
we're
disappointed
that
for
use
in
such
a
quick
break
.
without
really
having
necessarily
a
goal
hundred
percent
.
the
GTO
it
in
there
and
get
.
so
although
obviously
he
is
important
is
that
learning
that
maybe
the
lecture
the
first
that
is
really
important
and
valuable
than
the
of
finding
technology
after
the
fact
that
he
deserved
their
mobile
tool
that
can
be
used
to
cheat
.
each
player
to
be
.
and
the
ladies
maybe
you
measure
it
to
you
.
ninety
Integrated
to
use
existing
research
isn't
there
.
it
will
be
objective
.
and
that
again
this
is
more
of
that
instructor
have
the
evidence
presented
then
the
other
certainly
been
talking
about
with
you
the
reality
is
that
instructors
are
really
so
the
key
play
him
and
he's
there
so
that
barrier
.
and
it's
very
they
have
to
develop
students
to
intentionally
hauling
them
come
out
people
understand
that
goals
and
then
apply
the
technologies
have
made
him
more
Easier
and
more
approachable
and
they
get
more
seats
access
to
the
tools
.
finally
we
as
influencers
.
C
.
and
many
things
about
the
state
in
the
NHL
.
these
are
good
.
so
nobody
has
many
CG
tool
in
the
wildly
piece
of
their
last
era
me
if
I
had
been
backing
these
tools
are
they
still
are
additional
workers
students
and
many
recorded
.
it's
challenging
especially
in
situations
where
there
is
are
a
piece
of
the
tools
palette
they
were
just
in
time
.
these
judges
which
are
terrorism
the
Pentagon
school
production
of
the
show
and
technical
challenges
.
we
ten
years
you
get
to
see
you
have
in
its
relevance
and
social
or
so
.
it's
many
houses
and
interview
again
.
it
is
nothing
to
the
standoff
means
the
The
students
here
.
I'm
really
show
that
she
did
very
different
chapter
.
it
is
.
the
one
I'm
really
talking
about
observing
how
the
tools
are
use
to
really
using
the
appropriate
mark
he
even
more
sensible
and
earnings
cycle
.
Yemen
is
literally
the
window
literally
stop
at
either
twenty
access
because
there
they
can
remember
use
their
learning
instructors
and
a
lot
of
simply
says
that
.
the
hearings
that
regard
.
it
seems
you
are
value
of
tools
.
over
the
course
.
to
.
.
.
K
.
this
Research
still
has
only
get
our
hands
.
these
are
the
remaining
divisions
that
lend
to
share
these
youths
and
some
Structure
scenes
of
great
things
during
that
same
.
so
this
person
point
Learner
said
the
Learner
centered
codes
is
important
is
most
visited
just
for
many
.
this
is
really
apply
understatement
.
we
know
that
the
reluctance
to
change
the
Teaching
methodology
is
thousand
and
ten
students
and
very
lonely
and
accountable
and
being
passive
learners
this
equipment
in
the
past
.
there
is
no
challenge
get
some
expects
them
to
take
ownership
of
their
own
learning
.
unfortunately
we
are
expected
Plans
gate
to
change
very
quickly
.
because
he's
learning
environments
are
complex
social
systems
we
think
there
is
opportunity
for
change
and
perhaps
that
Cheney
for
change
can
be
best
time
to
the
best
approach
from
thestudent
perspective
and
not
necessarily
from
Faculty
perspective
.
can
Center
in
the
availability
of
key
media
tools
can
help
students
think
about
how
the
engaging
with
their
learning
materials
engaging
with
each
other
.
then
we
can
do
this
is
an
area
we're
exploring
.
because
some
learners
under
some
circumstances
in
its
Research
Center
has
needed
direct
their
own
learning
activities
.
we
see
this
is
in
their
crossing
creating
an
area
for
further
research
.
we
had
some
Preliminary
Recommendations
again
.
Gary
luminaries
last
time
we
don't
want
you
to
walk
away
his
visitation
feeling
WHY
you
seen
that
variety
at
Massey
contradictory
results
and
that's
transfer
read
you
what
did
he
do
about
it
.
even
though
the
research
needs
to
go
further
.
we
think
that
they
time
understandings
.
our
academic
institutions
and
Learning
Systems
.
the
preliminary
results
from
research
we
can
make
send
useful
recommendations
.
so
one
thing
that
is
actually
fairly
easy
that
we
as
technology
providers
can
do
is
to
provide
access
to
these
tools
settle
all
the
NASA's
caps
on
these
tools
he
has
assembled
discussion
forum
.
and
our
recommendation
is
that
these
tools
be
turned
on
by
default
in
courses
where
in
Faculty
are
using
them
or
not
.
they
may
say
oh
my
Leader
I
hate
that
because
it
wants
teens
participating
in
an
environment
that
they're
not
moderate
.
there
are
ways
of
socializing
this
.
he
and
.
one
rated
team
that
is
seized
framework
for
an
setting
expectations
.
and
so
.
even
the
use
of
PBS
will
is
not
likely
to
be
scaffolded
in
the
course
it
is
because
not
remain
instructors
are
adopting
the
technologies
they
can
be
scaffolded
in
context
outside
of
courses
where
its
teams
are
staying
in
various
kinds
that
learning
activities
mean
I
actually
Course
related
activities
.
so
resembling
orientations
.
give
me
examples
of
how
institutions
to
set
up
on
line
orientation
sessions
that
included
various
types
of
PDA
House
seems
work
together
in
small
groups
to
get
engage
one
another
.
this
is
a
great
opportunity
to
use
Scaffold
.
How
are
these
types
of
activities
can
be
firm
.
structured
in
ardor
for
Stevenson
given
us
that
bit
of
it
.
and
Research
is
not
only
are
to
learn
how
use
the
technologies
that
more
importantly
to
learn
the
rules
of
engagement
in
many
cases
to
learn
to
be
leaders
in
this
case
is
as
you
stopper
Aaron
Slide
tell
five
.
I'm
and
there
are
just
a
handful
of
teams
in
a
particular
class
that
become
the
leaders
and
and
they
can
be
Alliance
that
actually
live
do
the
decent
level
for
everyone
else
class
.
there's
news
for
the
current
study
just
out
time
social
contacts
.
and
this
can
actually
be
built
into
orientations
in
terms
of
helping
students
to
find
the
rules
in
engagement
and
how
communities
of
learning
should
Wired
.
SEN
.
honored
visit
visit
I
kept
going
to
be
tried
in
orientation
secured
the
provide
intro
courses
play
QB
Kyle
Allen
versus
content
layout
some
of
the
research
indicated
that
its
teams
here
have
successfully
used
p
media
tools
entire
courses
have
their
cancer
DT
use
these
tools
.
in
other
courses
sound
.
the
technologies
are
always
on
you
in
on
all
courses
.
and
then
Stevens
had
some
examples
of
how
to
tease
that
we
think
that
this
didn't
open
until
our
time
former
in
for
Larry
Gates
man
in
courses
where
the
instructors
are
not
actually
getting
in
each
ear
activists
in
terms
of
how
to
use
that
schools
.
the
other
things
that
can
be
useful
is
to
the
various
ways
of
building
community
and
learning
cohorts
up
and
again
this
is
part
of
what
happened
in
orientation
.
Research
as
an
esteemed
SI
state
with
their
degrees
in
finance
then
eventually
succeed
.
tease
though
because
of
other
people
within
the
institution
.
not
and
those
are
sometimes
causes
are
sometimes
teachers
.
learners
to
someone
who
comes
here
and
says
and
argue
that
assignments
she
pens
the
styling
and
they're
like
oh
yes
have
to
get
assignment
.
we
did
the
research
and
I'll
Research
poll
by
the
research
assignment
learning
cohorts
in
very
important
.
so
.
that
those
communities
need
to
be
billed
clients
and
basic
premises
in
terms
of
providing
the
teams
with
Stacy
insecure
environments
are
thinking
and
a
and
experimentation
in
their
exploration
of
materials
and
for
that
very
against
the
simple
technology
things
that
we
can
do
.
but
require
identity
.
Pujols
had
an
option
for
posting
on
its
to
the
turnout
and
I
said
people
to
speak
honestly
and
frankly
as
themselves
in
these
environments
.
and
that
leads
to
a
generally
.
How
is
that
generally
leads
to
you
.
in
fact
it
.
self
policing
in
these
environments
and
to
send
a
responsibility
.
and
the
other
simple
thing
to
do
is
he
not
turned
up
access
to
these
team
the
entire
into
Banda
works
.
John
not
in
others
.
Explain
how
this
practice
which
is
unfortunately
common
is
lying
if
you
are
working
and
building
a
base
that
community
than
three
months
Emmanuel
one
day
and
everything
and
I
community
.
I
was
on
.
on
what
kind
Chalk
without
the
House
an
old
WHY
AN
tablets
you
try
again
to
build
that
kind
of
community
.
that's
what
happened
so
and
we
have
these
elements
is
where
all
of
courses
to
have
to
be
available
to
lead
the
for
the
class
starts
in
the
Navy
and
the
oval
week
after
that
together
.
students
need
Learning
In
Class
creation
opportunities
.
they're
not
time
not
style
Semester
.
in
fact
.
and
we're
we're
exploring
and
very
optimistic
about
Additional
opportunities
for
students
to
have
learning
cohorts
and
sister
learning
context
outside
courses
time
these
technologies
are
already
available
for
many
of
learning
management
systems
or
a
on
NASA's
can
be
used
to
facilitate
this
even
if
not
explicitly
a
feature
of
the
on
the
US
said
that
time
various
kinds
of
groups
can
have
their
and
collaboration
.
activities
.
that
will
stand
courses
can
even
kill
the
on
specific
topics
they're
standing
in
the
courses
.
CMS
for
a
can
of
other
ideas
submitted
you
simple
things
that
we
is
technology
providers
can
do
to
help
create
an
environment
that
is
can
t
sit
to
use
time
counting
.
and
I'm
going
context
for
Learner
Self
engagement
.
cs
.
here's
to
to
outlying
areas
for
further
research
to
employees
and
UC
Berkeley's
Center
for
Next
Generation
Teaching
and
Learning
In
some
through
blackboardinstitute
in
collaboration
.
we
need
your
help
.
said
you
know
I
poignancy
existing
research
.
it's
related
these
topics
.
you
can
help
by
contributing
research
in
these
areas
.
and
you
can
tell
you
that
your
research
your
car
that's
so
as
we
see
on
the
table
we
needed
some
ballparks
and
have
information
about
the
survey
.
this
is
just
one
tool
though
are
using
.
it
seemed
like
team
content
and
qualitative
information
directly
from
students
based
on
their
Usage
Pini
in
schools
regardless
of
I
regard
sn
technology
.
because
we
need
to
expand
the
survey
results
come
further
team
to
try
range
students
and
time
seems
variety
of
different
institutions
and
said
only
in
currency
a
two
to
tell
us
just
to
be
these
adaptations
to
see
him
sound
later
colleagues
now
ask
them
to
history
as
you
know
it's
hard
to
get
research
directly
from
students
.
there
are
certainly
opportunities
upper
classes
that
are
starting
in
all
he'd
like
to
work
with
us
and
we
came
to
create
those
are
nails
in
those
courses
.
and
and
just
generally
E
.
and
to
the
results
that
are
the
air
.
variety
at
addition
all
.
work
alone
show
different
types
of
classes
in
earnings
.
Center
thank
you
very
much
for
years
tension
and
he's
already
cooperating
with
you
.
.
.
.