# embeddings_queue

created_at: 2024-11-07 15:52:18
topic: persistent://default/default/0084ccb6-b27e-4ea2-92e1-37bea2d6cc25
id: 3ed4f7f7917c30af64826215013a2cce67acff4822dba40663f57ef3f969d6d8
encoding: FLOAT32
metadata:
{"file_path": "C:\\Users\\Emile\\Documents\\Opsci\\Code\\git\\ENOPrompt\\data\\chatbot_40_12\\KB_4012\\META\\Search quality - Content Library and API.pdf", "source_id": "e178dc13f4a90bd335fda82cbe36f8bfe928a206f4a5bf18371888c3f6946936", "page_number": 9, "split_id": 6, "split_idx_start": 12133, "chroma:document": "table shows all metric values across advanced search test queries by endpoint from\fNovember 8th, 2023 to November 15th, 2023. Representativeness is an average across alldimensions that are mentioned in the representativeness section.Entity typeEntity typeRecallRecallRepresentativeness -Representativeness -Paired t-testPaired t-testRepresentativeness -Representativeness -Welch t-testWelch t-testFacebook Page95%77%94%Facebook group93%71%93%Facebook event90%59%83%Facebook post83%70%93%Instagram account98%79%99%Instagram post78%83%99%Caveats and known limitationsWhy would results be inconsistent from one time point to another?Inconsistencies between identical searches made at separate time points can be caused by entityvisibility changes over time, which may be due to content being created, deleted or modified.There may also occasionally be short lags between when content is created or modified and whenit is indexed.Why am I not seeing an entity I can find on the platform?Apart from coverage gaps or delivery issues mentioned below (see Factors a\ufb00ecting recall), it ispossible the content is not eligible to be visible in the Meta Content Library and API. The visibilityrules for content are complex and constantly evolving with new policies and regulations, making itpossible that some content could be theoretically viewed by an individual on platform but notexposed via the Meta Content Library and API. For instance, visibility of some content isgeographically restricted to users from the country where the content was produced. Also, directmentions (via @) are not searchable, meaning that a result will not be returned if a matching term is\fonly found in a direct mention.Why would a search result not match my query?Apart from tokenization issues listed below (see Factors a\ufb00ecting precision), it is possible that thecontent actually does contain the search terms, but they are found in di\ufb00erent text fields or farapart within the text. Search matches query terms independently and scans all text fields visiblefrom the UI. It also does not support phrase searching. Thus a search for \u201cWalter Payton\u201d couldmatch a page listing basketball players \u201cWalter "}


created_at: 2024-11-07 15:52:18
topic: persistent://default/default/0084ccb6-b27e-4ea2-92e1-37bea2d6cc25
id: d612637aa7645e7d95b2c7534e7bafd9cf6a0b822cc1ffe815b99916ccd323e3
encoding: FLOAT32
metadata:
{"file_path": "C:\\Users\\Emile\\Documents\\Opsci\\Code\\git\\ENOPrompt\\data\\chatbot_40_12\\KB_4012\\META\\Search quality - Content Library and API.pdf", "source_id": "e178dc13f4a90bd335fda82cbe36f8bfe928a206f4a5bf18371888c3f6946936", "page_number": 11, "split_id": 7, "split_idx_start": 14048, "chroma:document": "text fields or farapart within the text. Search matches query terms independently and scans all text fields visiblefrom the UI. It also does not support phrase searching. Thus a search for \u201cWalter Payton\u201d couldmatch a page listing basketball players \u201cWalter Williams\u201d and \u201cGary Payton\u201d without reference to a\u201cWalter Payton\u201d anywhere in the text.Factors a\ufb00ecting recallFalse positives in the validation data (denominator of recall equation). In our tests, we havefound that the validation dataset may occasionally include non-eligible entities for a givensearch term due to lags between real-time content visibility and privacy status and theirrepresentation in the databases used for validation (see validation data presented earlier).This means that true recall estimates are likely underestimated.Edge cases or gaps in coverage (true negatives). Indexing data at the scale which Metaoperates means that occasionally some content may be imperfectly indexed or missed.Furthermore, internal data models may change, such as when new features for creating andsharing content on platform are added. Thus there may be a lag between when content isavailable on platform and when it is indexed. As we improve and scale the product, weappreciate any reported cases of missing data from search (see Appendix on this page fordetails).Asynchronous delivery issues. The Meta Content Library and API\u2019s entity loading mechanismsare complex and memory-intensive at scale. Occasionally, the loading process for an entitycan become too memory-intensive and fail, resulting in the exclusion of that entity from thereturned results.Factors a\ufb00ecting precisionString-matching used to validate precision is unable to approximate tokenization rules.Precision is checked using basic regular expression searches with strict definitions of wordboundaries. However tokenization may be more flexible, especially with di\ufb00erent languagelocalizations, text involving unicode, URLs, and other patterns. The existence of these edgecases means that precision will be under-estimated to some extent.\fThe search term was tokenized in a context-specific way. Occasionally words with unicodesymbols, "}


created_at: 2024-11-07 15:52:18
topic: persistent://default/default/0084ccb6-b27e-4ea2-92e1-37bea2d6cc25
id: a599122ff104b22391ab75bd6c610526a7c145fa6ba134be08cee5a4369b9dae
encoding: FLOAT32
metadata:
{"file_path": "C:\\Users\\Emile\\Documents\\Opsci\\Code\\git\\ENOPrompt\\data\\chatbot_40_12\\KB_4012\\META\\Search quality - Content Library and API.pdf", "source_id": "e178dc13f4a90bd335fda82cbe36f8bfe928a206f4a5bf18371888c3f6946936", "page_number": 11, "split_id": 8, "split_idx_start": 15903, "chroma:document": "be more flexible, especially with di\ufb00erent languagelocalizations, text involving unicode, URLs, and other patterns. The existence of these edgecases means that precision will be under-estimated to some extent.\fThe search term was tokenized in a context-specific way. Occasionally words with unicodesymbols, non-English characters, accent marks or URLs may be tokenized in a form thatdi\ufb00ers from its presented value. For instance, the content with the French wordcongr\u00e9gation may be returned for a query on the English word congregation, despite theliteral di\ufb00erence between the acute accented e and its English counterpart.The index has matched text not returned by the Meta Content Library or API. In some cases,content with complex, nested data models such as reshares may contain text fields that aretokenized and indexed but not returned by the Meta Content Library or API. We appreciateuser feedback identifying such cases (see Appendix on this page for details).For the Facebook posts endpoint, there is a known issue involving post reshare text beingindexed but not returned in the Meta Content Library API. These posts may either have novisible text (since they are reshares), or the text returned may not contain any mention of thequery term. We are exploring this issue further.Factors a\ufb00ecting representativenessRepresentativeness issues generally stem from the same factors a\ufb00ecting recall. In thesecases there is a population of entities which are either (a) not returned by the Meta ContentLibrary API due to gaps in indexing / delivery, or (b) incorrectly included in the validationdataset adding noise to the calculation. If these groups of entities have similar propertiesalong the data dimensions tested they can influence the representativeness metricsThe per-query bias test uses a probabilistic statistical test which uses an alpha = 0.05 cuto\ufb00by convention. Thus for each test term there is a 5% probability that the test will be a falsepositive (Type I error rate).\nAppendixTest search "}


created_at: 2024-11-07 15:52:18
topic: persistent://default/default/0084ccb6-b27e-4ea2-92e1-37bea2d6cc25
id: 5ef3c48d57d17c3fc8fd017f7a1fefc539b84a545c6457ad628ed5187bcf6b8d
encoding: FLOAT32
metadata:
{"file_path": "C:\\Users\\Emile\\Documents\\Opsci\\Code\\git\\ENOPrompt\\data\\chatbot_40_12\\KB_4012\\META\\Search quality - Content Library and API.pdf", "source_id": "e178dc13f4a90bd335fda82cbe36f8bfe928a206f4a5bf18371888c3f6946936", "page_number": 12, "split_id": 9, "split_idx_start": 17648, "chroma:document": "representativeness metricsThe per-query bias test uses a probabilistic statistical test which uses an alpha = 0.05 cuto\ufb00by convention. Thus for each test term there is a 5% probability that the test will be a falsepositive (Type I error rate).\nAppendixTest search scope for endpointsThe following table summarizes the test search scope for all endpointsEndpointEndpointTest search scopeTest search scopeFacebook PageEligible Facebook pages created within the year prior to the query date\fContent Library and APIGet accessQuick linksContent LibraryContent Library APIAppendixData dictionaryField expansionSearch qualityGet API CodeShare producer listFacebook groupAll eligible Facebook groupsFacebook eventEligible Facebook events created within the year prior to the query dateFacebook postEligible posts created within two days prior to the given query dateInstagram accountEligible Instagram Creator and Business accounts created within a year prior to thequery dateInstagram postEligible posts created within a day prior to the given query dateLearn moreFacebook's search engine infrastructureDistributed memory caching layerAdvanced search guidelinesFrequently asked questions\fSupportDisclosures and DisclaimersCitations"}


created_at: 2024-11-07 15:52:18
topic: persistent://default/default/0084ccb6-b27e-4ea2-92e1-37bea2d6cc25
id: e615f775feb8547128aa9dedd9c32aab909ae5800cb220abfc561bc564596dec
encoding: FLOAT32
metadata:
{"file_path": "C:\\Users\\Emile\\Documents\\Opsci\\Code\\git\\ENOPrompt\\data\\chatbot_40_12\\KB_4012\\META\\Share producer list - Content Library and API.pdf", "source_id": "d509709e444031f1666b30fe596ab92996599e764ba783840798e7257ba0b01b", "page_number": 1, "split_id": 0, "split_idx_start": 0, "chroma:document": "DocumentiContent Library and APIAppendixShare producer listSu questa PaginaShare producer listProducer lists can be shared between Meta Content Library and Content Library API. Researcherscan see their producer list in the Producer lists tab in Content Library. Those you share a producerlist with must have the same account type as you to access the list.To share a producer list:Select Producers lists from the left navigation bar.Click View in the card for the producer list you want to share.\nClick the Share button in the producer list. The dropdown menu displays.\fSelect Copy link to get a URL link to the list or select Create API list ID to get an API Producerlist ID.If you select Copy link, the URL is copied to your clipboard and can be pasted into abrowser window to display the producer list.If you select Create API list ID, you will see a dialog with the ID which you can use toaccess the producer list in the API with the path received through the user interface.\nThe syntax of the snapshot of the producer list that can be accessed on the API is:/lists/producers/<api_producer_list_id>Request\fNameNameTypeTypeDescriptionDescriptionapi_producer_list_idStringUnique API ID created via UI fora snapshot of the producer listResponse structureNameNameTypeTypeDescriptionDescriptionidStringMCL ID of the shared producerlistnameStringName of the shared producer listplatformStringPlatform of the shared producerlist (Facebook or Instagram)producers.data[].idStringMCL ID of the producer in theproducer listproducers.data[].typeString`Type of the producer like groups,pages, events, pro\ufb01les, etc.producers.data[].nameString`Name of the producerSample querieslibrary(reticulate)client <- import(\"metacontentlibraryapi\")$MetaContentLibraryAPIClient\nR\nPython\fContent Library and APIGet accessQuick linksContent LibraryContent Library APIAppendixData dictionaryField expansionSearch qualityGet API CodeShare producer listSupportDisclosures and DisclaimersCitations# set default version to latestclient$set_default_version(client$LATEST_VERSION)# Get the response by using the API ID received by UIresponse <- client$get(path=\"lists/producers/2024-07-22-xlyr\")# Display the json responseresponse$textLearn moreContent Library API documentationSearch guideGetting started\f"}


created_at: 2024-11-07 15:52:18
topic: persistent://default/default/0084ccb6-b27e-4ea2-92e1-37bea2d6cc25
id: cfea23ab15a23b432bff110358c53c2bc9ec2f4408c889b0755ed05ad48ac007
encoding: FLOAT32
metadata:
{"file_path": "C:\\Users\\Emile\\Documents\\Opsci\\Code\\git\\ENOPrompt\\data\\chatbot_40_12\\KB_4012\\META\\Support - Content Library and API.pdf", "source_id": "43555aaa36b0618f5d24daabb7bdd73aaefa349668ad1f94b084da102ab700c3", "page_number": 1, "split_id": 0, "split_idx_start": 0, "chroma:document": "DocumentiContent Library and APISupport\fSu questa PaginaSupportFor product support and troubleshooting, you can raise a ticket to the Meta Support Community totriage and help with your questions.See Get help to learn how to access and use this tool.But first:For answers to many common questions, see Frequently asked questions.For questions related to the application for access and eligibility requirements, please refer tothe Meta Content Library and API application page at the Inter-university Consortium forPolitical and Social Research (ICPSR)Content Library and APIGet accessQuick linksContent LibraryContent Library APIAppendixSupportFAQGet HelpDisclosures and DisclaimersCitations"}


# collections

id: 0084ccb6-b27e-4ea2-92e1-37bea2d6cc25
name: documents
database_id: 00000000-0000-0000-0000-000000000000
config_json_str:
{"hnsw_configuration": {"space": "l2", "ef_construction": 100, "ef_search": 10, "num_threads": 12, "M": 16, "resize_factor": 1.2, "batch_size": 100, "sync_threshold": 1000, "_type": "HNSWConfigurationInternal"}, "_type": "CollectionConfigurationInternal"}


# embedding_metadata

key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\Bing Qualified Researcher Program - Microsoft Support.pdf


key: chroma:document
string_value:
SupportSupportSupportSupportMicrosoft 365OfficeBuy Microsoft 365Buy Microsoft 365Buy Microsoft 365Buy Microsoft 365SignBing Qualified Researcher ProgramBing’s Qualified Researcher program provides access to data that is publicly accessible on Bing, uponapplication, for researchers that satisfy the following criteria: The researcher or research organization is independent from commercial interests.The researcher application adequately discloses the funding of the research.The researcher must be capable of fulfilling specific data security and confidentiality requirementsand sufficiently protect any personal data. The application must disclose the technical security andorganizational measures it employs to protect data security and confidentiality requirements.The application must demonstrate that the proposed access to the requested data and the timeframes requested are necessary for, and proportionate to, the purposes of the proposed research.The expected results of the proposed research must contribute to the detection, identification andunderstanding of systemic risks in the European Union, as follows: The dissemination of illegal content through the Bing services. Any actual or foreseeable negative effects for the exercise fundamental rights, in particular thefundamental rights of human dignity enshrined in Article 1 of the Charter; respect for private andfamily life enshrined in Article 7 of the Charter, to the protection of personal data enshrined inArticle 8 of the Charter; freedom of expression and information, including the freedom andpluralism of the media, enshrined in Article 11 of the Charter; non-discrimination enshrined inArticle 21 of the Charter; respect for the rights of the child enshrined in Article 24 of the Charter;and a high-level of consumer protection enshrined in Article 38 of the Charter. Any actual or foreseeable negative effects on civic discourse and electoral processes, and publicsecurity. Any actual or foreseeable negative effects in relation to gender-based violence, the protection ofpublic health and minors, and serious negative consequences to the person’s physical and mentalwell-being.If you are a researcher or research organization interested in this program and believe your research meetsthe 


key: chroma:document
string_value:
foreseeable negative effects in relation to gender-based violence, the protection ofpublic health and minors, and serious negative consequences to the person’s physical and mentalwell-being.If you are a researcher or research organization interested in this program and believe your research meetsthe above qualifications, please complete this application form. We will treat any personal data included aspart of an application in accordance with our Privacy Policy. Any information that you submit as part of theapplication will not be treated as confidential information by Bing and may be referenced publicly. Even ifyou are selected for research access, you acknowledge and agree that Bing or other researchers are free toconduct research on the same or similar topics. How it worksFill out the application form and submit it in accordance with the instructions on the form. We will review the applications to access public data under the criteria set forth in Article 40(12) ofthe EU Digital Services Act. We may contact you for additional information necessary for us to assessyour application.We will notify you using the contact information you provide if you are selected.Selected researchers may be asked to enter into terms governing their access to the public data(and/or use of APIs (as applicable)) for the purpose of the approved research, including terms relatedto the security and legal use of personal data that may be made available to you under General DataProtection Regulation.At this time, we are not yet supporting requests for other research projects related to our public data. Forother research projects, researchers are welcome to access our Microsoft Research publications. Need more help?Need more help?Need more help?Need more help?Want more options?Want more options?Want more options?Want more options? Discover Discover Discover DiscoverCommunityCommunityCommunityCommunityExplore subscription benefits, browse training courses, learn how to secure your device, and more.How can we help you?
Microsoft 365subscription benefits
Microsoft 365 training
Microsoft security
Accessibility center
You’re invited 


key: chroma:document
string_value:
more help?Need more help?Want more options?Want more options?Want more options?Want more options? Discover Discover Discover DiscoverCommunityCommunityCommunityCommunityExplore subscription benefits, browse training courses, learn how to secure your device, and more.How can we help you?
Microsoft 365subscription benefits
Microsoft 365 training
Microsoft security
Accessibility center
You’re invited to tryMicrosoft 365 for freeUnlock now
What's newWhat's newWhat's newWhat's newSurface ProSurface LaptopSurface Laptop Studio 2Surface Laptop Go 3Microsoft CopilotAI in WindowsExplore Microsoft productsWindows 11 appsMicrosoft StoreMicrosoft StoreMicrosoft StoreMicrosoft StoreAccount profileDownload CenterMicrosoft Store supportReturnsOrder trackingCertified RefurbishedMicrosoft Store PromiseFlexible PaymentsEducationEducationEducationEducationMicrosoft in educationDevices for educationMicrosoft Teams for EducationMicrosoft 365 EducationHow to buy for your schoolEducator training and developmentDeals for students and parentsAzure for studentsBusinessBusinessBusinessBusinessMicrosoft CloudMicrosoft SecurityDynamics 365Microsoft 365Microsoft Power PlatformMicrosoft TeamsMicrosoft 365 CopilotSmall BusinessDeveloper & ITDeveloper & ITDeveloper & ITDeveloper & ITAzureDeveloper CenterDocumentationMicrosoft LearnMicrosoft Tech CommunityAzure MarketplaceAppSourceVisual StudioCompanyCompanyCompanyCompanyCareersAbout MicrosoftCompany newsPrivacy at MicrosoftInvestorsDiversity and inclusionAccessibilitySustainabilityEnglish (United States)Your Privacy ChoicesConsumer Health PrivacySitemap Contact Microsoft Privacy Terms of use Trademarks Safety & eco Recycling About our ads © Microsoft 2024ProductsDevicesAccount & billingResourcesAll Microsoft
Was this information helpful?Was this information helpful?Was this information helpful?Was this information helpful? YesYesYesYes NoNoNoNo×


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\CrowdTangle-Survey-Report-Final.pdf


key: chroma:document
string_value:
Blocking
our
Right
to
Know:
Surveying
the
Impact
of
Meta’s
CrowdTangle
Shutdown
Executive
Summary
Meta’s
data
access
tool
CrowdTangle
has
allowed
independent
watchdogs
to
uncover
foreign
interference
in
elections,
how
political
extremists
are
organizing
online,
the
spread
of
hate
speech
and
so
many
more
important
topics
on
Facebook
and
Instagram.
But
now,
the
company
is
planning
to
shut
down
CrowdTangle
,
right
in
the
middle
of
the
biggest
election
year
ever.
The
Coalition
for
Independent
Technology
Research
(CITR),
an
organization
of
more
than
400
independent
researchers
and
more
than
50
research
organizations,
conducted
a
survey
in
May
2024
to
understand
how
Meta’s
decision
would
impact
the
work
of
those
who
study
online
harms
and
report
out
to
the
public.
The
survey
found:
●
The
consequences
are
far-reaching
:
88%
of
researchers
surveyed
expressed
concern
that
CrowdTangle’s
shutdown
will
hinder
their
work,
as
projects
have
to
be
revised
or
scrapped,
with
some
considering
stopping
their
work
entirely.
●
The
replacement
is
insufficient
for
researchers:
Neither
Meta’s
proposed
substitute
Content
Library
nor
other
available
tools
offer
the
same
research
functionalities
as
CrowdTangle,
notably:
the
ability
to
track
and
download
all
posts
and
engagement
from
any
public
figure;
comprehensive
download
capabilities;
ease
of
use;
and
the
timeliness
of
data.
●
Access
is
extremely
limited,
especially
for
journalists:
Media
reports
suggest
that
only
a
small
percentage
of
CrowdTangle’s
tens
of
thousands
of
users
have
been
granted
Content
Library
access,
while
many
researchers
remain
stuck
in
the
application
process
or
have
not
bothered
to
apply
at
all
due
to
stronger
restrictions
on
who
is
allowed.
Currently,
no
for-profit
newsrooms
are
allowed
access–excluding
even
large
news
outlets
like
The
New
York
Times,
Fox
News
or
the
Daily
Mail.
Already
ahead
of
the
shutdown,
current
CrowdTangle
users
reported
experiencing
outages.Background
First
founded
in
2011,
CrowdTangle
was
created
to
help
nonprofits
build
social
networks
by
integrating
with
Facebook,
but
it
morphed
into
a
tool
that
allowed
people
to
see
what
stories
were
spreading
most
quickly
on
the
platform.
Facebook
bought
the
platform
in
2016
,
made
it
free
and
opened
it
to
thousands
of
new
users,
including
human
rights
organizations,
journalists,
fact-checkers
and
independent
researchers,
turning
it
into
a
leading
example
of
real-time
platform
transparency
across
the
social
media
industry.
CrowdTangle
has
since
been
used
to
identify
sources
of
disinformation
across
the
world
and
especially
among
the
Global
Majority;
correct
the
record
about
the
distribution
of
political
rhetoric
ahead
of
the
2020
U.S.
election
and
show
how
the
platform
was
used
to
organize
the
January
6
storming
of
the
U.S.
Capitol;
and
demonstrate
how
false
narratives
about
COVID-19
disseminated
.
But
in
recent
years,
Meta
began
shifting
resources
away
from
CrowdTangle,
prompting
speculation
they
would
shut
down
the
platform.
In
March
2024,
Meta
finally
made
the
long-expected
announcement
that
they
would
sunset
CrowdTangle
in
August
of
this
year,
claiming
the
platform
is
outdated
and
that
the
company’s
resources
would
be
better
spent
on
new
products
like
its
Content
Library.
While
the
Content
Library
does
have
some
potential
for
more
in-depth
academic
research,
it
is
a
new
tool
that
is
still
being
developed
and
currently
lacks
several
functions
that
make
CrowdTangle
so
valuable.
What’s
more,
Meta’s
rollout
of
the
transition
has
been
rushed
and
sloppy.
The
email
that
the
company
sent
to
CrowdTangle
users
notifying
them
of
the
shutdown
did
not
contain
information
about
who
was
eligible
to
access
alternative
tools
or
any
instructions
for
doing
so,
leaving
many
unsure
of
the
next
steps.
The
Content
Library
has
more
stringent
limitations
on
who
can
access
it,
and
best
estimates
place
its
current
user
base
at
just
a
few
hundred
,
while
CrowdTangle
allegedly
has
tens
of
thousands.
The
most
notable
exclusion
is
of
for-profit
organizations—thereby
prohibiting
a
majority
of
news
outlets.
Meta
has
given
no
clear
reason
for
this
provision,
but
past
reporting
has
revealed
Facebook
executives
questioning
why
they
should
provide
journalists
with
a
tool
that
can
reflect
poorly
on
the
company.
Regardless
of
the
reasoning,
it’s
clear
the
timing
of
the
shutdown
is
disastrous,
as
tens
of
thousands
of
independent
watchdogs
are
set
to
lose
access
to
Meta’s
data
in
the
middle
of
elections—
over
20
of
which
are
scheduled
to
be
held
between
the
shutdown
date
and
the
end
of
2024.
Hundreds
of
researchers
and
journalists
immediately
decried
the
decision
through
open
letters
from
Mozilla
and
the
Center
for
American
Progress
and
Institute
for
Strategic
Dialogue
calling
for
Meta
to
reconsider,
and
the
European
Commission
opened
formal
proceedings
into
Meta’s
compliance
with
the
Digital
Services
Act
,
citing
the
shutdown
of
CrowdTangle.
In
July,
a
letter
from
a
bipartisan
group
of
U.S.
lawmakers
called
for
Meta
to
maintain
the
platform
for
at
least
six
more
months
and
demanded
answers
from
the
company
about
many
of
the
issues
raised
in
this
report.
Yet
Meta
has
not
changed
course
on
its
decision
and
has
given
CrowdTangle
little
to
no
support
to
continue
functioning
even
before
the
shutdown.
2Methodology
The
Coalition
for
Independent
Technology
Research
conducted
a
survey
to
understand
what
the
loss
of
CrowdTangle
will
mean
for
independent
researchers
and
journalists
who
share
what’s
happening
online
with
the
public.
The
team
also
held
calls
with
members
of
the
community
and
conducted
unstructured
interviews
for
more
in-depth
insights.
The
survey,
conducted
in
May
2024,
garnered
36
responses
from
34
different
organizations,
including
major
news
outlets,
academic
institutions,
unaffiliated
researchers
and
civil
society
organizations.
1
The
survey
centered
around
the
following
questions:
●
How
will
CrowdTangle’s
shutdown
impact
the
work
of
academic,
journalist
and
civil
society
researchers?
●
Who
has
access
or
is
likely
to
attain
access
to
the
replacement
Meta
Content
Library?
●
Has
Meta
followed
through
on
its
promise
to
engage
with
civil
society
and
take
into
consideration
their
needs
during
the
“transition”
from
CrowdTangle
to
the
Content
Library?
Findings
1.
Far-reaching
consequences
for
humanity
For
researchers
who
have
been
using
the
tool,
CrowdTangle’s
shutdown
will
have
a
significant
impact
on
their
work,
interfering
with
the
public’s
right
to
information
about
important
topics
online.
Widespread
impact
88%
(32
out
of
36)
respondents
answered
“yes”
when
asked
if
they
had
concerns
about
the
ability
to
continue
their
current
research
projects
,
and
even
those
who
did
not
give
an
explicit
“
yes
”
noted
that
it
could
affect
them.
One
civil
society
organization
said
“
sort
of
”
because
they
already
stopped
using
CrowdTangle
a
year
ago
in
expectation
of
its
eventual
shutdown.
Even
the
one
respondent
who
said
“
no
”
clarified
that
they
have
resorted
to
direct
link-checking
tools
and
can
no
longer
establish
who
exactly
has
shared
links.
This
makes
it
much
more
difficult
to
identify
bot
networks
and
coordinated
malicious
activities,
including
cybercrime
networks.
By
limiting
the
scope
of
their
work
and
restraining
future
projects
to
what
they’ve
made
accessible,
Meta
is
determining
what
researchers
and
the
public
are
allowed
to
know—and
what
will
remain
hidden.
1
A
full
list
of
participating
organizations
can
be
provided
upon
request.
3Ending
entire
bodies
of
work
Some
researchers
claimed
that
they
were
likely
to
stop
their
work
entirely
due
to
the
shutdown.
Without
access
to
the
data,
some
found
it
would
be
impossible
to
continue
looking
into
Facebook
and
Instagram,
or
that
projects
cannot
continue
in
their
current
formats.
One
academic
institution
said,
“We
know
we
don’t
have
real
exploitable
access
to
relevant
Facebook
data
anymore.
This
means
we
will
probably
stop
working
with
Facebook
data
and
reorient
our
research
towards
other
data
sources.”
One
independent
researcher
has
no
funding
and
therefore
relies
on
tools
that
are
both
low-cost
and
easy
to
access.
CrowdTangle
was
celebrated
for
its
vast
capabilities
that
were
freely
accessible,
whereas
the
other
third-party
“social
listening”
tools
on
which
researchers
rely
are
built
for
marketers
and
advertisers
and
are
often
prohibitively
expensive.
Rather
than
attempting
the
complicated
process
of
gaining
access
to
the
Content
Library,
this
researcher
shared
that
they
“plan
on
discontinuing
my
work
as
an
independent
researcher
when
CrowdTangle
shuts
down.”
Incongruity
of
data
Switching
to
a
new
platform
with
different
capabilities
will
require
projects
to
be
reshaped
or
redone
entirely.
For
ongoing
projects,
work
has
to
be
revised,
costing
significant
staff
time
and
slowing
important
work.
One
academic
institution
reviews
and
compares
communication
on
social
media
about
a
broader
health
care
project.
Without
CrowdTangle,
they
will
have
to
change
the
way
they
pull
data
about
the
online
conversation,
so
it
won’t
be
directly
comparable
and
will
impact
the
project’s
ability
to
identify
the
most
salient
messages
about
public
health:
“CrowdTangle's
shutdown
in
the
middle
of
our
project
would
result
in
an
arbitrary
change
to
our
project
protocol
and
stopping
of
a
significant
portion
of
our
work
on
it.”
2.
Insufficient
replacement
While
the
Meta
Content
Library
does
include
new
valuable
functionalities,
like
showing
views
of
public
posts
and
access
to
comments
,
it
lacks
many
of
the
most
important
capabilities
of
CrowdTangle.
Respondents
most
cited:
the
ability
to
track
individual
accounts
of
influential
public
figures;
to
use
the
tool’s
download
capabilities;
its
ease
of
use;
and
the
timeliness
of
data.
Tracking
individual
profiles
Citing
privacy
concerns,
the
Meta
Content
Library
does
not
allow
users
to
track
individual
public
profiles
that
are
below
a
high
threshold
of
followers.
One
quarter
of
respondents
(9/36)
specified
this
as
a
lost
functionality
that
will
hinder
their
work
.
Many
highlighted
the
value
of
looking
at
politicians’
profiles
specifically,
while
others
noted
that
they
won’t
be
able
to
see
where
messages
originate.
The
ability
to
track
where
messages
originate
and
the
narrative
influence
of
leading
accounts
is
crucial.
Put
simply,
“
Reporting
on
bad
actors
on
social
media
requires
being
able
to
identify
the
bad
actors.
Currently
via
CrowdTangle
that
is
possible,
with
Meta
Content
Library
it
won't
be.”
4Case
study
The
civil
society
organization
Hashtag
Generation
works
to
stop
anti-minority
disinformation
and
hate
speech
on
Facebook
that
has
resulted
in
community
violence
in
Sri
Lanka.
They
map
harmful
content
and
track
it
to
the
original
actors
and
networks
in
order
to
support
pre-emptive
regulation
that
stops
such
posts
or
mitigates
their
spread.
They
share
this
information
with
other
CSOs,
U.N.
agencies
and
INGOs,
as
well
as
regulators—none
of
which
will
be
possible
without
CrowdTangle.
Download
capabilities
CrowdTangle
allows
users
to
download
data
from
accounts,
public
groups
or
pages
of
any
size,
which
gives
researchers
a
wide
range
of
uses.
Presently,
researchers
and
journalists
can
integrate
the
data
with
other
tools,
look
far
into
the
past
to
compare,
ensure
that
they
retain
what
they
need
for
future
projects
and
share
with
other
partners.
While
the
Content
Library
has
developed
more
download
capabilities,
it
remains
far
more
restricted,
which
nearly
20%
(7/36)
respondents
highlighted
as
an
issue
.
According
to
one
civil
society
organization,
“MCL
also
has
limitations
on
data
downloads/use
that
prevent
analysts
from
using
other
tools
to
interrogate
the
data.
These
limitations
will
both
slow
down
the
speed
we're
able
to
research
emerging
trends,
while
also
driving
up
the
costs
for
doing
so
(because
we'll
need
to
obtain
the
data/insights
through
other
proprietary
tools).”
Ease
of
use
While
the
Meta
Content
Library
includes
some
innovative
features,
it
is
also
more
difficult
to
use.
Four
respondents
highlighted
CrowdTangle’s
ease
of
use
as
one
of
its
most
important
features
that
will
be
lost
.
Some
claimed
that
the
Content
Library’s
complexity
only
makes
it
more
convoluted
rather
than
helpful.
For
organizations
working
with
tight
budgets
and
restrictions
on
staff
capacity,
this
is
especially
worrisome.
According
to
one
academic
institution,
“Since
CrowdTangle
is
an
agile
tool
that
does
not
require
necessary
coding
to
make
qualitative
observations
of
the
groups
and
pages
one
is
studying,
it
is
unfortunate
that
such
[a]
tool
will
be
divested
to
create
more
complex
tools
that
will
not
allow
qualitative
research
and
will
perhaps
only
provide
a
generalized
overview
of
what
happens
on
social
media,
making
nuance
hard
to
gather.”
Timeliness
CrowdTangle
lets
users
see
what
is
happening
on
the
platform
in
real
time,
which
is
crucial
to
identify
what’s
happening,
alert
Meta
and
potentially
mitigate
the
amplification
of
harmful
content.
Four
respondents
emphasized
this
as
a
fundamental
aspect
of
CrowdTangle
.
One
fact-checker
noted,
“[The
Meta
Content
Library
has]
no
ability
to
see
‘live’
engagement
counts
so
[it’s]
essentially
useless
as
a
tool
to
figure
out
what
is
the
most
viral
thing
about
a
topic
today.”
53.
Lack
of
access
to
the
alternatives
At
one
point,
CrowdTangle
included
nearly
100,000
registered
users
.
While
Meta
has
not
publicly
released
exact
numbers
for
the
Content
Library,
media
reports
suggest
that
just
a
few
hundred
researchers
have
access.
It
is
also
designed
for
a
different
kind
of
user,
with
an
emphasis
on
academic
institutions
and
the
prohibition
of
any
for-profit
organizations,
which
most
notably
excludes
many
prominent
media
outlets.
In
this
survey,
11
respondents
have
applied
for
access
to
the
Meta
Content
Library,
of
whom
only
five
have
been
granted
it
permanently
.
This
includes
mostly
academic
institutions
and
nonprofits,
with
one
nonprofit
fact-checker.
Even
for
those
who
are
theoretically
able
to
access
it,
the
process
is
complicated
and
time-consuming,
and
respondents
shared
that
Meta
has
not
been
responsive
to
requests
for
help.
No
access
for
journalists
As
of
now,
the
Meta
Content
Library
categorically
bans
all
commercial
media
outlets
from
independent
access
,
from
The
New
York
Times
to
Fox
News
to
the
Daily
Mail.
Meta
has
recently
adapted
the
guidelines
to
allow
access
for
those
with
a
research
agenda
and
not
just
a
specific
academic
research
project,
but
this
still
bars
a
majority
of
newsrooms
unless
they
have
some
sort
of
ongoing
research
collaboration
or
partnership
with
a
university
or
nonprofit.
Meta
has
yet
to
give
a
clear
explanation
for
why
it
now
believes
for-profit
organizations
shouldn’t
have
access,
as
it
will
impact
reporters
who
do
critical
reporting
on
technology’s
impacts
on
society.
Some
journalists
believe
it
was
explicitly
designed
to
cut
them
out.
One
news
outlet
claimed,
“I'm
a
journalist
so
I
don't
meet
the
legibility
[sic]
criteria.
They've
intentionally
structured
it
to
shut
out
journalists.”
Complicated
process
Even
for
those
who
are
eligible,
the
process
of
applying
to
the
Meta
Content
Library
is
convoluted
and
lengthy.
A
paper
from
the
Weizenbaum
Institute
detailed
additional
complications
with
the
process,
from
the
difficulty
of
finding
application
forms
to
the
strict
interpretations
of
eligibility
and
length
of
time
to
receive
responses.
Researchers
also
noted
that
they
need
to
provide
detailed
information
about
individuals,
which
brings
up
privacy
considerations,
and
that
the
time
lapse
may
impact
ongoing
work.
Meta
has
also
not
been
very
responsive
to
those
seeking
help.
In
its
initial
email
announcing
the
shutdown
of
CrowdTangle
to
all
users,
Meta
did
not
mention
the
Content
Library
or
any
details
about
how
users
could
apply
for
it—leading
several
to
wonder
if
it’s
truly
intended
as
a
replacement.
While
the
company
did
reach
out
to
14
of
the
surveyed
respondents
about
their
data
access
needs,
some
of
those
organizations
still
haven’t
been
given
access
to
the
Content
Library
after
applying
.
One
university
noted,
“When
I
emailed
them
about
applying
for
access
my
message
was
met
with
silence,
and
I
believe
others
had
the
same
experience.
There
is
no
clarity
on
how
applications
are
reviewed.”
6Lost
access
Users
are
already
facing
outages
on
CrowdTangle
before
the
transition
deadline,
likely
due
to
fewer
staff
working
on
the
platform.
Some
expect
such
disruptions
to
increase
as
users
download
data
before
the
shutdown
and
the
work
on
the
platform
gets
increasingly
outdated.
One
news
organization
has
already
lost
its
CrowdTangle
access,
and
their
requests
for
support
have
gone
unanswered.
Conclusion
In
a
year
when
nearly
half
the
world’s
population
is
going
to
the
polls,
malicious
actors
are
doing
their
best
to
interfere,
and
Meta
cannot
fend
them
off
alone.
Data
access
allows
journalists
and
researchers
to
cut
through
the
noise
to
track
and
counter
disinformation,
hate
speech
and
real-world
threats
to
health
and
safety,
especially
during
contentious
elections.
It
is
essential
that
social
media
companies
maintain
access
for
independent
watchdogs
now
and
into
the
future.
CrowdTangle
has
been
the
premier
tool
in
this
effort,
and
our
survey
demonstrates
that
the
public
interest
research
community
does
not
yet
have
a
sufficient
replacement.
Meta
should
dedicate
sufficient
resources
to
maintaining
CrowdTangle
and
to
improving
the
Content
Library
until
it
becomes
the
adept
data
access
tool
it
has
the
promise
to
be.
This
should
be
done
in
consultation
with
the
global
public
interest
research
community,
including
journalists
and
independent
researchers
in
the
Global
Majority,
to
ensure
their
needs
are
met.
This
means
improving
the
Content
Library’s
functionalities,
especially
in
terms
of
tracking
prominent
figures
and
accounts,
download
capabilities,
ease
of
use
and
timeliness.
And
it
also
means
streamlining
the
application
process
and
allowing
all
of
CrowdTangle’s
users
onto
the
new
platform,
including
newsrooms.
Thanks
to
the
tireless
advocacy
of
many
in
the
research
community,
Meta
has
taken
some
feedback
on
board,
including
expanding
access
to
the
Content
Library
for
more
civil
society
researchers
and
advocacy
groups
and
opening
up
new
capabilities
on
the
platform.
But
the
fact
remains:
It’s
not
enough.
To
preserve
access
to
crucial
data
and
protect
the
integrity
of
elections
globally,
Meta
should
keep
CrowdTangle
running
through
at
least
the
end
of
this
year
and
until
the
Content
Library
is
fully
functional
and
accessible.
Meta
has
been
celebrated
as
a
leader
for
data
access
and
transparency
compared
to
its
peers;
now
is
the
moment
for
the
company
to
live
up
to
its
principles
and
protect
the
public’s
right
to
know.
Acknowledgements
We
would
like
to
express
our
sincere
gratitude
for
the
intelligent
insights,
deep
expertise
and
astute
feedback
of
all
those
who
developed
and
reviewed
this
survey
and
report,
including:
Maia
Woluchem,
Brandi
Geurkink,
Cameron
Hickey,
Jo
Lukito,
Molly
Waiting
and
Claire
Pershan.
The
Coalition
for
Independent
Technology
Research
advances,
defends,
and
sustains
the
right
to
ethically
study
the
impact
of
technology
on
society .
The
Coalition
is
a
fiscally
sponsored
project
of
Aspiration,
a
registered
501(c)3
nonprofit
organization.
7


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\Data access for researchers _ LinkedIn Help.pdf


key: chroma:document
string_value:
Data access for researchersLast updated: 4 weeks agoAs of August 2023, we offer a [Beta] Researcher Access Program in order to meet our legal requirements underthe European Union’s Digital Services Act (DSA). Specifically, Article 40(12) of the DSA requires that we makeavailable to qualified researchers, upon application, data that is publicly accessible on LinkedIn, so long as thefollowing conditions are satisfied:
If you are a researcher interested in conducting this research, please fill out this application form. We will treatany personal data included as part of an application in accordance with our Privacy Policy. Any information thatyou submit as part of the application will not be treated as confidential information by LinkedIn or its affiliates.Even if you are selected for research access, you acknowledge and agree that LinkedIn, its affiliates, or otherresearchers are free to conduct research on the same or similar topics.How it works: At this time, we are not yet supporting requests for other research projects related to our public data. Please note,that we do allow certain researcher access to information regarding ads served on the LinkedIn services. For moreinformation, please see here.Was this answer helpful?Contact usLinkedIn Corporation © 2024AboutTransparency CenterResearchers must be independent from commercial interests.•The researcher’s application must disclose the funding of the research.•The researcher must be capable of fulfilling specific data security and confidentiality requirementscorresponding to each request and to protect personal data; and the researcher must describe in theapplication the appropriate technical and organisational measures that have been put in place to thisend.•The application must demonstrate that the access to the data and the time frames requested arenecessary for, and proportionate to, the purposes of their research.•The expected results of the proposed research must contribute to the detection, identification andunderstanding of systemic risks in the European Union, as follows: •The dissemination of illegal content through the 


key: chroma:document
string_value:
frames requested arenecessary for, and proportionate to, the purposes of their research.•The expected results of the proposed research must contribute to the detection, identification andunderstanding of systemic risks in the European Union, as follows: •The dissemination of illegal content through the services.•Any actual or foreseeable negative effects for the exercise fundamental rights, in particular thefundamental rights of human dignity enshrined in Article 1 of the Charter; respect for privateand family life enshrined in Article 7 of the Charter, to the protection of personal dataenshrined in Article 8 of the Charter; freedom of expression and information, including thefreedom and pluralism of the media, enshrined in Article 11 of the Charter; non-discriminationenshrined in Article 21 of the Charter; respect for the rights of the child enshrined in Article 24of the Charter; and a high-level of consumer protection enshrined in Article 38 of the Charter.•
Any actual or foreseeable negative effects on civic discourse and electoral processes, andpublic security.•Any actual or foreseeable negative effects in relation to gender-based violence, the protectionof public health and minors, and serious negative consequences to the person’s physical andmental well-being•
Fill out the application form and submit it in accordance with the instructions on the form.•We will review the applications to access public data under the criteria set forth in Article 40(12) of theDSA. We may contact you for additional information necessary for us to assess your application.•We will notify you using the contact information you provide if you are selected. •Selected researchers will be asked to enter into terms governing their access to the public data (and/oruse of APIs (as applicable) for the purpose of the approved research, including terms related to thesecurity and legal use of personal data that may be made available to you under General Data ProtectionRegulation.•
YesNo
English (English)Privacy and TermsDue to high support volume, it may take longer 


key: chroma:document
string_value:
for the purpose of the approved research, including terms related to thesecurity and legal use of personal data that may be made available to you under General Data ProtectionRegulation.•
YesNo
English (English)Privacy and TermsDue to high support volume, it may take longer than usual to hear back from our Support Agents.Help
How can we help?LinkedIn


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\Data Accessibility Update_ X Takes a Tumble, TikTok Inches Forward _ ADL.pdf


key: chroma:document
string_value:
Anti-Defamation League605 Third AvenueNew York, NY 10158-3650(212) 885.7700FinancialsContactNewsletter SignupPrivacy PolicyADL en EspañolEventsResearch & AnalysisFind Ways to GivePress Center𝕏𝕏𝕏𝕏© 2024 Anti-Defamation League. All Rights Reserved.
ARTICLEData Accessibility Update: X Takes aTumble, TikTok Inches Forward
JUMP TO1. Introduction2. User Data & APIs: How TheyWork3. Scoring Platforms on DataAccessibility
RELATED RESOURCESARTICLEPro[ting from Hate:Platforms’ Ad…Placement ProblemSeptember 27, 2023
ARTICLEFundraising for Hate:Platforms’ Revenue-…GeneratingOpportunitiesNovember 30, 2023
Published: 12.20.2023Online Hate & HarassmentFrom: Center for Technology and Society
For researchers and civil society organizations who track online antisemitism andother forms of hate, access to data from social media platforms is essential toverify platforms’ claims and expose gaps in policy enforcement. Accurate andcomprehensive data from platforms allows groups such as ADL to understandthe extent and nature of online hate and extremist activity, the experiences ofvictims, and steps platforms are or are not taking to address harmful content.Without this kind of data access, the public is left with few options to validatetech companies’ assertions when reporting on hate speech and enforcementmetrics. As part of ADL ’s 2021 Online Antisemitism Report Card, ADL included a scorecardevaluating platforms for their commitment to researcher access to data. Since our initial report, however, some platforms have taken steps backwards interms of data access. In 2023 two major mainstream platforms, Reddit and X,began monetizing their previously free access to platform data. This restricts theability of interested parties, such as researchers and volunteer communitymoderators (e.g. Reddit mods,) to monitor and take action against problematicspeech. PlatformsFreePublicDataAPIAcademicResearcherData APIAccess orExpandedAccessCivilSocietyData APIAccessorExpandedAccessAPIMonetizationFree SearchFunctionality& DataFreeStreamingFunctionality& DataFreeAPIRateLimitsQualityDocumentation(Yes/No)
🟢
Yes
🟢
Yes;expandedratelimits
🟢
Yes;expandedratelimits
🟡
24 cents /1,000requests(free fornon-commercialresearchersand somemoderationtools)
🟢
Public
🟢
Yes (forlivethreads)
🟢
1,000requests/10minutes
🟢
Yes
🟢
Yes
🟢
Yes;expandedratelimits
🔴
No
🟢
None
🟢
Public
🔴
No
🟡
10kunits/day(increasedforacademics)
🟢
Yes
🟡
Yes (forchannelsresearcheris a partof)
🔴
No
🔴
No
🟢
None
🔴
No
🔴
No
🟢
Variable -50requests/secondfor bots
🟢
Yes
🔴
No
🟢
Yes - thisis theonlygroup towhichAPI isavailable
🔴
No
🟢
None
🟡
US andEuropeacademicresearchersonly
🔴
No
🟡
1,000requests/day(Academicsonly)
🟢
Yes
🔴
No
🟢
Yes (APIforresearchersonly)
🟢
Yes (APIforresearchersonly)
🟢
None
🟡
Majorlimitationsto availabledata, andforqualiPedresearchersonly
🔴
No
🟡
60 queries/minute,500,000posts/week
🟢
Yes
🟡
Yes(videosonly, nochat)
🔴
No
🔴
No
🟢
None
🔴
By gameonly
🔴
No
🟢
30requests/minute
🟢
Yes
🔴
No
🔴
No
🔴
No
🔴
$100/month(basic),$5,000/month(pro),$42,000-210,000+/month(Enterprise)
🔴
No; searchfor Pro orEnterpriseonly
🔴
No; livetweetdecahoseandsearch forPro orEnterpriseonlyN/A
🟢
Yes
Search...
User Data & APIs: How They WorkSocial media platforms collect untold volumes of user data, which is sold toadvertisers and used to maximize engagement on the platforms, for immensepro[t. This business model, sometimes called “surveillance capitalism,” 


key: chroma:document
string_value:
Pro orEnterpriseonly
🔴
No; livetweetdecahoseandsearch forPro orEnterpriseonlyN/A
🟢
Yes
Search...
User Data & APIs: How They WorkSocial media platforms collect untold volumes of user data, which is sold toadvertisers and used to maximize engagement on the platforms, for immensepro[t. This business model, sometimes called “surveillance capitalism,” meansthat tech companies have an incentive to collect granular personal data bymaximizing the amount of time users spend watching, scrolling, liking, andclicking on their sites—even when the content is hateful or incendiary. But techcompanies also have a responsibility to make online spaces just and equitable,protecting users from harmful content such as hate and harassment. Making platform data transparent and accessible to the public ensures thatindependent researchers, including from academia and civil society, can evaluatetech companies’ claims about enforcing their rules, such as how much violativecontent they remove or otherwise sanction. Data access also allows researchersto study online hate and harassment and to better understand the experiences oftargets, not to mention extremist activity. Without this degree of transparency,platforms’ claims about moderation and user safety are impossible to verify. Community moderators and developers rely on data access tools as well,including third-party content moderation tools for sites like Reddit, Discord, andTwitch. Without access to Application Programming Interfaces (API), moderatorsare unable to access, report, and remove content violating rules for theirparticular online communities, such as subreddits or Discord channels.Restricting or monetizing data access hurts researchers, moderators, andultimately the public that relies on social media for conversation, connection, andcommunity. APIs serve as intermediaries between different pieces of software, allowing themto communicate using a sort of common language. In the context of platformresearch, this typically entails researchers submitting requests for speci[c publicdata from the platform and having the requested data returned by the API. Forexample, to study the rate or nature of antisemitic posts over a given period, ADLmight request posts containing the word “Jewish,” posted between 


key: chroma:document
string_value:
submitting requests for speci[c publicdata from the platform and having the requested data returned by the API. Forexample, to study the rate or nature of antisemitic posts over a given period, ADLmight request posts containing the word “Jewish,” posted between October 7 andOctober 14, that have received at least 1,000 likes. A popular way of explaining APIs is to compare them to a server at a restaurant.The technical infrastructure of the platform where data is stored, structured, andmade visible for interactions is like the restaurant’s kitchen – the general public isnot allowed in. But, if you know how to place an order correctly (by putting in a“call” to the API), the API can go back into the kitchen for you with your requestand bring you out what you need. Olcial API access from platforms is critical to research because it is generallyconsidered the most complete and reliable source of data about social mediacontent and user engagement. While there are other means of collecting data,including purchasing data from third parties and “scraping” it from the internet,these methods often require more time and/or effort. They can also be blockedby anti-automation measures such as CAPTCHA, leading to incomplete data or atotal lack of access at scale. Although scraping public data is considered lawful,it generally violates platforms’ terms of service. Platforms prohibit scraping forseveral reasons: they have a [nancial incentive to retain sole access to datasetsof user behavior at scale (to sell to advertisers and improve the platform) andprohibiting scraping also keeps their servers from being overwhelmed byrequests and protects user privacy. To extend the earlier metaphor, walking intothe kitchen yourself is generally frowned upon by the restaurant; while you mightbe able to get something to eat before you’re kicked out, it may be more like asmattering of ingredients than a full meal. Scoring Platforms 


key: chroma:document
string_value:
earlier metaphor, walking intothe kitchen yourself is generally frowned upon by the restaurant; while you mightbe able to get something to eat before you’re kicked out, it may be more like asmattering of ingredients than a full meal. Scoring Platforms on DataAccessibility Olcial API access is not a one-size-[ts all solution: the utility of platform APIs isaffected by a number of other factors. Our updated Data Accessibility Scorecardevaluates the extent and functionality of each major platform’s data access forresearchers, using several criteria: The primary question is who has access; are APIs open to the general public,to researchers generally or only speci[c types of researchers, or only to thoseorganizations (frequently corporations) who can afford them? What data is accessible, and can it be easily queried via search? Can live data and/or random samples of platform content be acquired? What usage limits (also known as rate limits or quotas) cap the amount of datathat can be requested? And does the platform publish clear and thorough documentation meant to aidin the proper use of their API? The updated Data Accessibility Scorecard addresses these questions, assigningeach platform a composite score based on [ve categories: groups provided APIaccess, extent of API monetization, available data, search capability, and ratelimits. These scores provide an overview of the state of data accessibility oneight major platforms in 2023, and largely paint a dire picture. Reddit Reddit’s API provides access to public data, increased rate limits for researchers(although even after several weeks, Reddit had not responded to ADL ’s requestsfor researcher status), search functionality with a number of [lters, a rate limitthat allows for 100 requests per minute with no further daily quota (forcomparison, TikTok limits API usage to 1,000 requests a day), and even access tolive data in the form of Live Threads. Despite these helpful features, Redditcharges third parties for higher rate requests 


key: chroma:document
string_value:
requests per minute with no further daily quota (forcomparison, TikTok limits API usage to 1,000 requests a day), and even access tolive data in the form of Live Threads. Despite these helpful features, Redditcharges third parties for higher rate requests (largely in response to concernsthat OpenAI and other AI companies are using Reddit content as training datawithout compensation). Some press speculated that Reddit made this move toboost revenue in advance of an expected upcoming IPO). Reddit does not charge non-commercial researchers for API access, nor formoderation bots--though such bots require time and technical knowledge toimplement. However, monetization has severely affected popular third-party toolswhich made moderation at scale more manageable for Reddit’s volunteermoderators without the necessary hours and coding expertise. It is not the mereact of monetizing the Reddit API that proved to be a problem but the pricing,which Apollo CEO Christian Selig estimated at roughly 72x the cost of data fromImgur, a similar platform to Reddit. In response to this change, Reddit moderators launched strikes and blackouts ofpopular subreddits. And while Reddit made some concessions for accessibility-focused apps, the platform otherwise forced through its changes. Third-partyapps which once aided Reddit's volunteer moderators have been severelyaffected by the high cost of API access: Apollo has shuttered entirely, whilethrough a partnership with Reddit, Pushshift has become available to moderatorsonly. It has also been beset with technical hiccups and obstacles such as single-use access tokens that prevent the automation of moderation. While Reddit’s APInow provides the most accessible data among mainstream platform APIs; itslower score in 2023 versus 2021 reqects the effect of this monetization schemeon the community moderators Reddit relies upon to identify and take actionagainst violative content. YouTube YouTube offers a data API to the general public with additional data access foracademic researchers. Its strengths include retroactive search functionality,detailed and clear documentation, and 


key: chroma:document
string_value:
this monetization schemeon the community moderators Reddit relies upon to identify and take actionagainst violative content. YouTube YouTube offers a data API to the general public with additional data access foracademic researchers. Its strengths include retroactive search functionality,detailed and clear documentation, and access to videos, comments,recommended videos, and metadata for videos and user pages. Its maindrawback is its rate limit, especially for civil society researchers (academicresearchers are eligible for higher limits as part of its higher educationprogram). The public Data API offers 10,000 “units” a day, but search requests are heavilyweighted, costing 100 units and returning only 10 videos for each search. If usingthe API for searches, only 100 searches would be permitted per day which putsYouTube’s rate limits below even TikTok’s 1,000 search requests per day andincludes fewer results per search. Unlike TikTok, there is opportunity for theserates to be expanded for certain approved academic researchers. YouTubeshould also add the ability to track comment threads beyond immediate replies(that is, one level deep). The features available in this API are expansive, buthigher rate limits are necessary for non-academic researchers. Discord Discord, a chat platform for online gamers and other communities, consists ofprivate channels created by users. Accordingly, there is no truly “public” data.Researchers must already be members of a given channel to access data. Thetools described in the Discord API documentation are largely geared towardsintegration with bots and moderation--with options such as setting up auto-moderation rules and pinning messages--more than they are tailored towardsresearch applications. While the API features a high rate limit, it lacks searchfunctionality, hampering its utility for research: channels or particular posts wouldneed to [rst be located manually by a researcher, rather than discovered throughsearch queries. TikTok In 2023, TikTok launched its Research API, initially for academic researchers inthe United States, and then in Europe. Although the API can return data on videos,comments, 


key: chroma:document
string_value:
posts wouldneed to [rst be located manually by a researcher, rather than discovered throughsearch queries. TikTok In 2023, TikTok launched its Research API, initially for academic researchers inthe United States, and then in Europe. Although the API can return data on videos,comments, and user pages, and there is a search feature in the API with anumber of [lters, several other features are lacking or missing. For example, only1,000 comments may be collected per post; there is no way of [ltering by Stichesto or Duets with a video (the TikTok version of reply threads); and follower listsare not available despite being public on the app and on the web. TikTok still doesnot provide access to civil society researchers, including ADL. Moreover, therequirements for approved researchers are onerous: they must refresh data every[fteen days and share outputs with TikTok seven days in advance of publication(this is a signi[cant improvement over the original requirement of 30 days). Theplatform has also still not made available an API tracking content moderationactions, which was promised alongside the data API in July 2022, nor indicatedwhen (or if) it will. But the most serious limitation of the TikTok API is its rate limitof only 1,000 requests for data per day, lagging other similar platform APIofferings, with no possibility for expanded access. This low rate limit curtails thescale of research possible on the platform. Meta (Facebook and Instagram) In 2016, Facebook purchased CrowdTangle, a tool for tracking trends and howposts perform on the platform. From 2017 onwards, especially after the 2018Cambridge Analytica Scandal, Facebook began to roll back CrowdTangle access.By 2022, Meta had removed CrowdTangle support entirely.In late 2023 Meta released its Public Content Library and API, available toresearchers alliated with a “quali[ed academic institution or a quali[ed researchinstitution.” The documentation for this API and its features is clear, and the “GetCode” option 


key: chroma:document
string_value:
removed CrowdTangle support entirely.In late 2023 Meta released its Public Content Library and API, available toresearchers alliated with a “quali[ed academic institution or a quali[ed researchinstitution.” The documentation for this API and its features is clear, and the “GetCode” option on the web application is especially useful for researchers with lesscoding experience; it a feature other platforms would do well to adapt. Meta’s ratelimit of 60 requests/minute is fairly generous, though the weekly cap of 500,000posts a week could hinder some research. The primary concern about Meta’s new Content Library and API is what is notavailable. Foremost, comments and stories cannot be collected for eitherplatform, leaving large swaths of data on user activity inaccessible. WhatsApp isabsent from the API, likely due to the platform’s more private nature. Finally, alltags of individual users are excluded and anonymized. While this may be a usefulstep in protecting the privacy of most individual users, it presents a seriousobstacle to studying activity surrounding public [gures such as politicians andcelebrities. Twitch Like Discord, Twitch operates primarily as a secondary platform for onlinegamers where creators can livestream gameplay. Also, similarly to Discord,Twitch’s API is better suited to content creators and moderators thanresearchers. Video recordings of completed streams made public by theircreators may be obtained, but no further data is available. Live video streams andchat logs, arguably the two most important aspects of this streaming platform,are inaccessible. This data is available only when streamers grant expresspermission to researchers to collect this data and approve their software fordoing so; otherwise, the Twitch API is limited only to video recordings. Theprevious version of this scorecard weighted reporting and moderation tools moreheavily, whereas in this update we prioritize accessibility of raw data, whichaccounts for the change in Twitch’s rating.X Once the gold standard of olcial data APIs, X has gated access to data behindsteep 


key: chroma:document
string_value:
of this scorecard weighted reporting and moderation tools moreheavily, whereas in this update we prioritize accessibility of raw data, whichaccounts for the change in Twitch’s rating.X Once the gold standard of olcial data APIs, X has gated access to data behindsteep subscription fees. In March 2023, X announced the details of its revisedAPI access tiers, olcially ending a 17-year era of free API access. Previously, thegeneral public could retrieve up to 2 million tweets per month and access arandom 1% of the live “[rehose” stream of all tweets for free, and academicresearchers could retrieve up to 10 million Tweets per month without charge.Now, the free tier of API access includes just write-only access (e.g. postingtweets), making the API unsuitable for researchers. The $100/month “Basic” tier includes only 10,000 post reads per month. The nexttier up costs $5,000/month, with access to 1 million posts per month (a tenth ofwhat was previously available to researchers for free). Only at this tier do searchand the live stream of tweets become available. Further access is available viathe Enterprise tier, with plans from $42,000/month to $210,000+/month. Suchsums are beyond the reach of most researchers, rendering access to X costprohibitive to all but companies and organizations with deep pockets. Footnotes1. Available data and rate limits were scored based on the best free tier of dataaccess for the platforms with paid API access options. 1𝕏𝕏𝕏𝕏 Find Your Local ADLReport an Incident⚠Press2. User Data & APIs: How They Work
TOP


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\DSA 40 Collaboratory – Information, Networking & Support for Platform Data Access.pdf


key: chroma:document
string_value:
DSA40 Data AccessOur goal is to connect, inform andsupport researchers with platformdata access requests based on DSAArticle 40.We also track the implementation ofthis legislation to inform politicians,the interested public and otherstakeholders.Our ProjectsNewslettersPublicationsDSA40 Data Access TrackerImprintDSA 40 Data Access CollaboratoryEuropean New School of DigitalStudiesEuropean University ViadrinaGroße Scharrnstraße 5915230 Frankfurt (Oder)Germanycontact@dsa40collaboratory.eua joint project by
funded by Stiftung Mercator
Copyright © 2024 DSA 40 CollaboratoryPrivacy Policy
Information, Networking & Support forPLATFORM DATA ACCESSArticle 40 of the Digital Services Act (DSA) requires platforms to grant data access to researchers and non-proﬁtorganisations in order to detect, identify and understand systemic risks in the European Union.The DSA 40 Data Access CollaboratoryDSA 40 Data Access Collaboratory provides up-to-date information on the legislation’simplementation, networking activities, and advisory services for researchers, lawmakers, and the interestedpublic.SIGN UP TO OUR MAILING LISTCONTACT US
Our Projects
NewsletterRead our previous newsletters and sign up to stayinformed about everything related to DSA Article 40.
Access TrackerTrack your data access application and help us tosupport future data access requests.
PublicationsBrowse everything we have published on DSA Article 40and data access thus far.Stay up-to-dateSign up to our newsletter to receive updates on DSA40 data accessand new projects by the Collaboratory.Enter your nameEnter your emailConsent to Data Processing Consent to Data Processing *
I consent to the processing of my personal information as de-tailed in the privacy policy.SUBMITData Access BasicsFrequently AskedQuestionsWho can submit DSA 40 data access applications?Who can submit DSA 40 data access applications?What data can be requested?What data can be requested?What are systemic risks?What are systemic risks?Have more questions? Have more questions? Contact us!Contact us!The DSA 40 Collaboratory Core Team
Ulrike KlingerPrincipal InvestigatorEuropean University Viadrina
Jakob OhmePrincipal InvestigatorWeizenbaum Institute
Lukas SeilingCollaboratory Coordinator
Sophia GrafExecutive Assistant
ABOUT THE COLLABORATORYThe DSA40 Data Access TrackerKeep track of youraccess applicationWe call upon researchers and other non-proﬁt organisations to sharetheir data access requests with us, so that we caninform the public about the 


key: chroma:document
string_value:
Viadrina
Jakob OhmePrincipal InvestigatorWeizenbaum Institute
Lukas SeilingCollaboratory Coordinator
Sophia GrafExecutive Assistant
ABOUT THE COLLABORATORYThe DSA40 Data Access TrackerKeep track of youraccess applicationWe call upon researchers and other non-proﬁt organisations to sharetheir data access requests with us, so that we caninform the public about the success rate of access requestsdevelop guidance for successful access requestsinform ongoing regulatory processes REGISTER YOUR APPLICATION
30complete applicationsregistered23applications have beendecided by the platforms29applications have requestedpublic data★ 14applications were acceptedby the platformsHomeAboutAccess TrackerPublicationsContact Us


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\Meta Is Getting Rid of CrowdTangle—and Its Replacement Isn’t as Transparent or Accessible - Columbia.pdf


key: chroma:document
string_value:
✉
AboutMissionMastheadPrivacy PolicyContactSupport CJRBecome a MemberDonateAdvertiseContact Us
Meta Is Getting Rid of CrowdTangle—and Its Replacement Isn’t asTransparent or AccessibleThe social media monitoring tool, which has been used to track misinformation, is setto disappear as elections take place worldwideJULY 9, 2024By SARAH GREVY GOTFREDSEN AND KAITLYN DOWLING
Image: Menlo Park, CA, USA - Apr 30, 2022: Closeup of the Meta sign at the entrance to the Meta Platformsheadquarters in Menlo Park, California. Meta Platforms, Inc. is an American tech conglomerate. 502702485abSign up for The Media Today, CJR’s daily newsletter.This piece has been copublished with Proof News.The US elections are less than ﬁve months away, and the publichas less visibility than ever into political messaging onFacebook and Instagram. In August, Meta is shutting down CrowdTangle, a popularsocial media monitoring tool used to track misinformation onFacebook and Instagram. The company says its replacement,the Meta Content Library (MCL), is a better tool forresearchers. But a joint investigation by Proof News, the Tow Center forDigital Journalism, and the Algorithmic Transparency Institutefound that Meta’s replacement tool is less transparent andaccessible than CrowdTangle. On eleven key topics, Meta’snew tool has fewer features than CrowdTangle. Andresearchers say the process of getting access to the tool iscumbersome and slow—and some journalists can’t access it atall.That means that journalists and researchers will have lessability to trace online information about the elections, of whichover sixty are set to take place worldwide in 2024.“The decision to deprecate the tool will have a direct eﬀect onelection integrity experts and their ability to do their work,” said Claire Pershan, EU advocacy lead at the MozillaFoundation. For more than a decade, journalists, researchers, and electionobservers have used CrowdTangle to monitor trends onFacebook and Instagram. The tool has helped journalists shedlight on the popularity of right-wing ﬁgures on Facebook,monitored inﬂuencers during elections, and tracked healthmisinformation during the pandemic. The 


key: chroma:document
string_value:
than a decade, journalists, researchers, and electionobservers have used CrowdTangle to monitor trends onFacebook and Instagram. The tool has helped journalists shedlight on the popularity of right-wing ﬁgures on Facebook,monitored inﬂuencers during elections, and tracked healthmisinformation during the pandemic. The rise of generative AIhas raised further concerns about the potential proliferation ofelection misinformation and political candidate deepfakes onsocial media platforms. While the MCL oﬀers some new features, like the ability to seehow many people have viewed a public post and access tocomments and short-form videos (an increasingly signiﬁcantform of social content), it also lacks many of the features thatmake CrowdTangle a valuable research tool. These limitationsinclude restrictions on exporting data, the inability to track postperformance over time, the lack of direct links to public posts,and fewer features for collaboration. Nor does Meta’s MCLenable users to track how channels in a custom list areperforming—a key feature on CrowdTangle that has beenuseful to researchers.But data transparency isn’t the only issue, researchers say. Whogets access is just as important. Unlike CrowdTangle, whichwas open for anyone to use, the MCL is restricted to academicand nonproﬁt researchers, which excludes most news outlets.Given that academic research is notoriously slow, the publiccould lose out on the rapid-response stories enabled byjournalists using CrowdTangle data.CrowdT angle vs. MCL
Research by Proof News, the Tow Center for Digital Journalism, and AlgorithmicTransparency Institute.Get the data
Search in table
FeatureFeatureCrowdTangleCrowdTangleMCLMCLDownloadable dataUsers can downloaddata from accounts,groups (public), orpages of any size.Users may onlydownload datasets of"publicly-accessiblecontent posted bywidely-known figuresand organizations" —specifically with averified badge or 25,000or more followers, andpublic pages with 15,000or more likes/followers.Archival DataCaptures multiplesnapshots for posts',pages', groups', andaccounts' performance,so a user can assessreach and engagementover time.Offers real-timeperformance data, nohistorical information.LeaderboardLeaderboard rankschannels based onengagement from agiven list. It allows auser to understand whoin a given list isproducing content thatis performing well.Does not have thisfeature.
IntelligenceOffers a powerfulinteractive 


key: chroma:document
string_value:
posts',pages', groups', andaccounts' performance,so a user can assessreach and engagementover time.Offers real-timeperformance data, nohistorical information.LeaderboardLeaderboard rankschannels based onengagement from agiven list. It allows auser to understand whoin a given list isproducing content thatis performing well.Does not have thisfeature.
IntelligenceOffers a powerfulinteractive datavisualization tool thatenables users to identifytrends and inflectionpoints that guideresearch andinvestigation.Does not have thisfeature.Direct link to publicpostsUsers can access publiccontent directly onFacebook andInstagram.Does not provide directlinks.Batch uploadAllows users to quicklyupload several channelsto a list via CSV ratherthan manually addingthem one-by-one,facilitating research at alarger scale.Does not have thisfeature.Share dashboardsAllows for collaborationamong users on asingular dashboardcentering multiplepeople’s work in oneplace.Does not have thisfeature.Filter and sortoptionsUsers can filter bynumber of pagefollowers, engagement,local relevance, verifiedstatus, and performancescores, among otheroptions.Does not offer thosespecific options andoverall, has significantlyfewer choices.ViewsDoes not measure viewsexcept on Facebookvideo and Facebook livevideo posts.Includes views on publicposts.Short-form videos(reels)Does not include dataon reels.Short-form video data isavailable.CommentsUsers can view the totalnumber of comments ona post.Users canprogrammaticallyanalyze posts andcomments via the API.Users can viewcomments within theuser interface.Live displayAllows a user tocompare severalstreams of contentaround a given topic orevent.Does not have thisfeature.Save postsAllows users tobookmark posts for lateranalysis.Does not have thisfeature.WeightsAllows a user to exploreposts receiving aparticular reaction (like,love, haha, etc.).Does not have thisfeature.EventsDoes not have thisfeature.Captures data fromFacebook events.CrowdTangle was founded by Brandon Silverman and MattGarmur in 2011 and started attracting big media clients likeBuzzFeed, CNN, Vox, USA Today, and NBC. Meta acquired it in2016 and decided to make the tool free and expand access tomore media partners. But in March of this year, Metaannounced CrowdTangle will be discontinued after August 14. In an open letter to Meta, dozens of nonproﬁts and newsroomsaround the world called on the company to keep CrowdTanglefunctioning until January 2025 and to onboard to the MCL allcurrent CrowdTangle organizations that are focused onelection integrity. The letter has been signed by 


key: chroma:document
string_value:
letter to Meta, dozens of nonproﬁts and newsroomsaround the world called on the company to keep CrowdTanglefunctioning until January 2025 and to onboard to the MCL allcurrent CrowdTangle organizations that are focused onelection integrity. The letter has been signed by more than 170individuals and organizations, including Silverman,CrowdTangle’s former CEO. But despite outside pressure to delay CrowdTangle’s closure,Meta spokesperson Erin McPike said the company is sticking tothe original deadline. When asked at an MIT Technology Review conference whyCrowdTangle is being discontinued during a big election year,Nick Clegg, Meta’s president of global aﬀairs, claimed it’sbecause CrowdTangle is a “degrading tool.” CrowdTangle'sinability to measure reach, according to Clegg, hampers itsability to show what’s actually going viral. “It only measures anarrow cake slice of a cake slice,” he said. Despite this, Metahas actively used and advocated for CrowdTangle for years—even giving election boards in all US states access during the2020 election to help quickly identify misinformation andvoter interference and suppression. Meta says that its decision to discontinue CrowdTangle is aneﬀort to meet data access requirements set by the EuropeanUnion’s Digital Service Act (DSA). European law requires thatlarge social media companies like Meta put in place eﬀectivereal-time election-monitoring tools. But the European Commission has indicated that the MCLdoes not meet its requirements. In April, the commissioninitiated formal proceedings against Meta into potentialviolations of the DSA. One concern: timing. With several European elections on thehorizon, the commission stated that deprecating a tool likeCrowdTangle could damage civic discourse and electoralprocesses. There is currently no “adequate replacement” forCrowdTangle, the commission stated in a public statement. In response, Meta added country-speciﬁc dashboards inCrowdTangle for each EU country but said it still planned tostop supporting CrowdTangle in August. “We have a well-established process for identifying andmitigating risks on our platforms. We look forward tocontinuing our cooperation with the European Commissionand 


key: chroma:document
string_value:
added country-speciﬁc dashboards inCrowdTangle for each EU country but said it still planned tostop supporting CrowdTangle in August. “We have a well-established process for identifying andmitigating risks on our platforms. We look forward tocontinuing our cooperation with the European Commissionand providing them with further details of this work,” Metasaid in a statement, as reported by the BBC.None of this addresses the exclusion of for-proﬁt pressorganizations from access to the new tool. And researchers whoare eligible to apply for access to the MCL API—which allowsprogrammatic queries of the data—say the application processcan be time-consuming and cumbersome. Researchers must submit their application through Meta’sindependent partner ICPSR at the University of Michigan—aprocess that requires approval from an institutional reviewboard (IRB), institutional signatures, and evidence of technicalskills. (These steps are not required for the Web version of theMCL application, which allows researchers to explore datathrough a user-friendly graphical interface but without thesame level of control and ﬂexibility as the API.) Some researchers’ applications were stuck in limbo for a month—sometimes longer—according to Josephine Lukito, assistantprofessor at the University of Texas at Austin’s School ofJournalism and Media. “It has been really damaging both to my work as well as that ofgraduate students I work with and other researchers I knowwho are studying the US elections,” Lukito said. Meta initially released the MCL and its associated API as a betaversion in 2023, allowing a select group of researchers to testit. Lena Frischlich, an associate professor at the DigitalDemocracy Centre of the University of Southern Denmark, wasone of them. According to Frischlich, the technical focus of theMCL application could pose hurdles to some researchers withno programming knowledge.“ Assuming I apply as a Principal Investigator with a lesstechnical, for example, humanistic background, I need to hire adata scientist,” Frischlich said. “But CrowdTangle wasaccessible even for someone with zero 


key: chroma:document
string_value:
application could pose hurdles to some researchers withno programming knowledge.“ Assuming I apply as a Principal Investigator with a lesstechnical, for example, humanistic background, I need to hire adata scientist,” Frischlich said. “But CrowdTangle wasaccessible even for someone with zero programming skills.” While there are diﬀerences between the two tools, Frischlichsaid she is encouraged by the open dialogue between Meta’sdeveloper team and researchers. “I do see that some of the things we discussed during that timehave resulted in substantial changes in data access,” she said.For instance, Meta added a feature that lets researchersanalyze comments on public posts—something that was neveravailable on CrowdTangle. This feature, along with the abilityto download speciﬁc subsets of data, was later added to thelibrary.But none of the content of the MCL matters, other researcherssay, if no one can access it. “It’s not primarily about data points, it’s about access,” saidPershan, the EU advocacy lead from Mozilla. WhileCrowdTangle was accessible to tens of thousands of people, theMCL might be very limited, she said. Fabio Giglietto, an associate professor of internet studies at theUniversity of Urbino, in Italy, was also among the early testersof the Meta’s MCL.“In my opinion, the Meta Content Library seems to be moremodern,” Giglietto said. “But it does have limits. In my speciﬁcuse case, it prevents me from performing certain tasks that Ican currently do with CrowdTangle.” One of these limits, Giglietto said, is the restrictions on dataexporting. Giglietto is working on Vera AI EU, a disinformationresearch project that taps into CrowdTangle data to detectcoordinated link sharing. The results are automaticallyuploaded to a Google Sheet three times a day and handed oﬀ tofact-checkers and disinformation experts. But this kind ofautomated export is currently not permitted on the MCL,Giglietto said, which makes it more diﬃcult to share resultswith outsiders. CrowdTangle’s accessibility allowed New York Times 


key: chroma:document
string_value:
Sheet three times a day and handed oﬀ tofact-checkers and disinformation experts. But this kind ofautomated export is currently not permitted on the MCL,Giglietto said, which makes it more diﬃcult to share resultswith outsiders. CrowdTangle’s accessibility allowed New York Times reporterKevin Roose to track the rise of far-right media on Facebook.With Giglietto’s assistance, Roose set up an automated Twitteraccount in 2020 called @FacebooksTop10 that showed thesources of the most engaged link posts by US pages based onCrowdTangle data. The daily listing was regularly dominatedby partisan news outlets and right-wing commentators like BenShapiro and Dan Bongino. It became an embarrassment forFacebook executives who, according to Roose, were left toexplain “the disparity between what they thought Facebookwas—a clean, well-lit public square where civility and tolerancereign—and the image they saw reﬂected in the Twitter lists.” Giglietto pointed to the @FacebooksTop10 bot as an exampleof something that would no longer be possible with the MCL inits current form. Meta spokesperson McPike said the MCL provides morecomprehensive data overall than CrowdTangle: “ Althoughdownloads for all public content is not supported in the MCL’sUser Interface, MCL has more comprehensive data that spans awider range of accounts and proﬁles than CrowdTangle.” Getting rid of CrowdTangle will produce ripple eﬀectsthroughout the broader research community. Journalists, civilsociety researchers, and academics have built infrastructure ontop of CrowdTangle that relies on its stream of data to function.The Illuminating project—which provides real-time analysis ofthe US presidential candidates’ X and Facebook accounts—isjust one example. According to Illuminating Research leadJennifer Stromer-Galley, the corporations that facilitate ourpublic town squares have a civic obligation to enable journalistsand researchers to help make the discussions, and the actorswho facilitate them, transparent. “The health of our democracydepends on it,” she wrote in an email. Another example of a tool that depends on CrowdTangle isHamilton 68, an online inﬂuence tracker 


key: chroma:document
string_value:
journalistsand researchers to help make the discussions, and the actorswho facilitate them, transparent. “The health of our democracydepends on it,” she wrote in an email. Another example of a tool that depends on CrowdTangle isHamilton 68, an online inﬂuence tracker that uses networkanalysis to detect Russian propaganda and disinformationeﬀorts. Hamilton 68 may stop running altogether onceCrowdTangle is put to rest, the Columbia Journalism Reviewreported.This piece has been copublished with Proof News.
ABOUT THE TOW CENTERThe Tow Center for Digital Journalism at Columbia's Graduate School ofJournalism, a partner of CJR, is a research center exploring the ways in whichtechnology is changing journalism, its practice and its consumption — as weseek new ways to judge the reliability, standards, and credibility of informationonline.View other Tow articles »Visit Tow Center website »
The voice of journalism, since 1961
Copyright 2024, Columbia Journalism Review
00Meta1HacketVa


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\Public_Data_Access_Programs__A_First_Look.pdf


key: chroma:document
string_value:
1Public
Data
Access
Programs:
A
First
Look
Assessing
Researcher
Data
Access
Programs Under
The
Digit al
Services
Act
E x e c u t i v e
S u m m a r y
O v e r v i e w
This
report
represents
an
in-depth
effort
to
systematically
evaluate
the
data
access
programs
provided
by
the
major
online
platforms
who
are
regulated
by
the
EUʼs
Digital
Services
Act
DSA.
We
look
specifically
at
access
to
publicly
accessible
data.
Data
access
for
researchers,
journalists,
and
NGOs
is
critical
to
ensuring
that
threats
on
these
platforms,
for
instance
to
civic
discourse
or
public
security,
are
identified,
the
companies
are
held
accountable
to
the
public,
and
ultimately
that
the
rights
of
citizens
are
protected.
In
this
report
we
provide
both
a
rubric
for
evaluating
these
programs
based
on
a
detailed
set
of
criteria
as
well
as
the
first
set
of
scores
using
that
criteria
to
produce
a
moment-in-time
scorecard.
We
rate
each
platform
based
on
an
independent
assessment
of
what
the
research
community
believes
is
needed
to
further
research
in
the
public
interest.
We
examine
what
data
these
platforms
make
available
to
researchers,
the
usability
of
these
systems,
the
accessibility
of
the
programs
to
researchers,
the
terms
and
conditions
applied
to
this
access,
and
the
security
and
privacy
provisions
they
employ.
Where
possible
we
have
tested
and
compared
these
systems
to
the
public
data
we
see
on
these
sites,
and
otherwise
we
have
reviewed
public
statements,
forms,
and
documentation
about
each
program.
We
have
also
reached
out
to
each
platform
directly
to
ask
clarifying
questions
and
to
seek
additional
information
about
access.
Our
grades
reflect
all
of
the
platform
offerings
we
could
identify
and
examine
as
of
May
2024
and
represent
a
snapshot
of
the
programs.
Most
of
the
programs
detailed
in
this
report
are
new,
and
several
changed
over
the
course
of
our
research.
We
hope
and
anticipate
that
these
programs
will
continue
to
expand
and
evolve
through
further
use,
scrutiny,
and
guidance
by
researchers
and
regulators.
2R a n k i n g s
Each
platformʼs
data
access
program
was
assessed
using
47
measurement
questions
grouped
into
five
categories:
Quality,
Ease
of
Use,
Accessibility,
Terms
of
Use,
and
Privacy
and
Security.
The
aggregate
results
rank
the
platforms
by
adding
the
average
scores
for
each
category
together
into
one
composite
score:
3Based
on
these
findings,
we
identify
key
recommendations
for
regulators
both
in
the
EU,
and
more
broadly
seeking
to
increase
the
impact
of
their
rules,
for
researchers
exploring
how
to
make
use
of
platform
data,
and
for
the
platforms
themselves
to
improve
their
offerings.
We
anticipate
that
this
process
can
be
repeated
periodically
to
evaluate
improvements
over
time
for
public
interest
research.
K e y
F i n d i n g s
P l a t f o r m s
h a v e
e m p l o y e d
f o u r
d i s t i n c t
a p p r o a c h e s
t o
p r o v i d i n g
r e s e a r c h e r ʼ s
p u b l i c
d a t a
a c c e s s
We
observed
that
platforms
have
varying
approaches
to
sharing
public
data
with
researchers
,
that
can
be
summarized
as:
1.
F o r m a l
p r o g r a m s :
five
platforms
have
created
new
and
specific
systems
and
tooling
for
researchers
investigating
systemic
risks
in
the
EU.
2.
E x i s t i n g
p r o g r a m s
a n d
A P I s :
five
platforms
provide
or
have
repurposed
existing
APIs
and
researcher
programs
that
can
be
used
in
the
context
of
DSA-related
research.
3.
P e r m i s s i o n
t o
s c r a p e :
several
platforms
explicitly
or
implicitly
permit
data
scraping
as
a
means
of
data
access.
4.
D a t a
r e q u e s t s :
three
platforms
invite
researchers
to
request
specific
data
sets
on
an
individual
basis
but
do
not
document
what
exists
or
provide
a
standard
mechanism
for
access.
5.
N o
e f f o r t s
t o
p r o v i d e
a c c e s s
t o
p u b l i c
d a t a ? 
two
platforms
do
not
appear
to
have
developed
any
formal
mechanism
for
researchers
to
access
public
data
at
this
time.
D a t a
s c r a p i n g
h a s
e m e r g e d
a s
a n
o f f e r i n g
f r o m
s e v e r a l
p r o m i n e n t
p l a t f o r m s
Alphabet
Google
Search,
Play
Store,
Shopping,
and
YouTube)
explicitly
acknowledges
data
scraping
as
a
means
for
enabling
researchers
access
to
public
data.
Booking.com,
Amazon,
and
Pinterest
i m p l i c i t l y
allow
data
scraping
for
non-commercial
purposes
through
their
terms
of
service.
By
offering
researchers
permission
to
scrape
data,
these
platforms
model
a
valuable
approach
and
normalize
the
concept
which
may
increase
the
value
of
scraping
as
a
tool
for
public
interest
research
in
the
future.
P u b l i c
d a t a
a c c e s s
p r o g r a m s
a r e
n e w ,
a n d
o f t e n
l a c k
v i s i b i 


key: chroma:document
string_value:
y
allow
data
scraping
for
non-commercial
purposes
through
their
terms
of
service.
By
offering
researchers
permission
to
scrape
data,
these
platforms
model
a
valuable
approach
and
normalize
the
concept
which
may
increase
the
value
of
scraping
as
a
tool
for
public
interest
research
in
the
future.
P u b l i c
d a t a
a c c e s s
p r o g r a m s
a r e
n e w ,
a n d
o f t e n
l a c k
v i s i b i l i t y
a n d
d o c u m e n t a t i o n
Platforms
have
only
recently
introduced
new
programs
or
adjusted
existing
ones.
At
this
time,
few
researchers
have
gained
access,
and
fewer
still
have
systematically
probed
the
data
to
understand
the
benefits
and
limitations
of
the
programs.
Critically,
access
to
4information,
data
documentation,
and
technical
support
all
appear
to
be
extremely
limited
at
this
time
and
in
some
cases
very
difficult
to
find
even
when
they
do
exist.
W e
l a c k
s h a r e d
d e f i n i t i o n s
f o r
“ p u b l i c
d a t a ˮ
a n d
w h o
s h o u l d
g e t
a c c e s s
t o
i t
There
exists
no
clear
or
agreed
upon
definition
of
what
qualifies
as
“public.ˮ
Each
platform
has
made
different
decisions
about
what
data
to
share,
and
in
many
cases
those
choices
may
differ
from
researcher
expectations.
In
addition,
platforms
have
varying
or
ambiguous
criteria
for
who
is
eligible
to
access
data.
This
lack
of
clarity
and
standardization
makes
it
difficult
for
the
platforms
to
provide
the
best
offerings
and
for
researchers
to
conduct
research.
R a p i d
r e s p o n s e
a n d
e x p l o r a t o r y
r e s e a r c h
a r e
n o t
r e a d i l y
e n a b l e d
A
significant
portion
of
the
research
programs
offered
at
this
time
require
detailed
applications
and
vetting
or
specific
and
time-bound
research
questions.
The
response
time
for
access
applications
is
variable,
and
rarely
immediate.
As
a
result,
research
into
real-time
emerging
threats
is
limited
and
challenging
at
this
time.
This
is
significant
as
a
primary
use
case
of
public
data
access
is
for
rapid
response
and
monitoring
research,
as
for
example
with
Metaʼs
CrowdTangle
or
Twitter/Xʼs
API
prior
to
May
2023.
T e c h n i c a l
a n d
p o l i c y
l i m i t a t i o n s
o n
d a t a
a c c e s s
m a y
h i n d e r
r e s e a r c h
q u a l i t y
Many
of
the
programs
impose
rate
limits
on
the
volume
of
data
that
may
be
accessed,
the
speed
at
which
data
may
be
collected,
and
the
exact
data
that
may
be
stored
locally
by
researchers.
These
limitations
are
likely
to
limit
research
that
aims
to
define
the
scale
of
specific
risks
on
a
platform,
or
that
processes
and
analyzes
media
posted
to
a
platform.
T o p l i n e
R e c o m m e n d a t i o n s
We
have
identified
25
recommendations
for
regulators,
platforms,
and
researchers
based
on
the
findings
of
this
research
which
are
detailed
later
in
this
report.
Our
highest
priority
recommendations
for
regulators
and
platforms
are
outlined
below:
R egulat ors
should
pr o vide
cle ar
fr ame w or ks
f or
shar ing
public
dat a
Regulators
globally
should
provide
clear
and
harmonized
frameworks
for
public
data
sharing
between
tech
companies
and
public
interest
researchers.
Such
frameworks
should
clarify
what
constitutes
public
data
for
public
interest
research
purposes.
They
should
also
ensure
safe
harbor
for
independent
data
collection
for
public
interest
research.
Currently,
the
European
Union
has
the
most
developed
legal
framework
under
the
Digital
Services
Act.
While
some
questions
related
to
public
data
sharing
will
likely
be
addressed
in
the
forthcoming
Delegated
Act
on
Article
40,
the
European
Commission
should
provide
5further
guidance
in
relation
to
data
sharing
under
Article
40.12.
This
guidance
should,
inter
alia,
clarify
what
constitutes
“publicly
accessible
dataˮ
for
these
research
purposes
and
set
a
baseline
for
the
specifications
and
documentation
of
data
sharing,
so
that
researchers,
auditors,
and
regulators
can
effectively
evaluate
these
programs.
Several
major
platforms
already
permit
data
scraping
as
a
form
of
data
access
for
research,
presumably
because
this
is
both
easy
to
implement
and
demonstrates
a
clear
connection
with
what
is
“publicˮ.
Critically,
guidance
should
also
ensure
that
researchers
physically
located
outside
of
the
EU
will
have
access
to
data
needed
to
conduct
research
related
to
systemic
risks
in
the
European
Union.
Plat f or ms
should
f acilit at e
r e al
or
ne ar -r e al
time
monit or ing
Exploratory
and
rapid-response
research
requires
timely
and
flexible
access
to
public
data
in
response
to
real-world
events.
This
work
is
often
done
by
non-academically
affiliated
researchers
including
journalists.
Platforms
should
facilitate
the
use
of
public
data
for
real
or
near-real
time
monitoring
and
ensure
that
all
relevant
researchers
conduct
this
research.
Platforms
should
allow
organization-based
access
to
research
programs,
in
addition
to
project-based
access.
Interactive
dashboards
are
an
ideal
mechanism
for
empowering
non-technical
researchers,
particularly
from
journalism
and
civil
society,
to
investigate
public
data
in
real-time.
R ese ar chers
should
activ el y
r equest
dat a
and
document
t heir
e xper iences.
Many
of
the
platforms
we
evaluated
reported
to
us
that
they
have
received
very
few
requests
for
data.
While
the
“vettedˮ
researcher
process
under
the
Digital
Services
Act
is
still
being
built,
the
public
data
sharing
programs
are
already
in
place.
Academic
researchers,
civil
society
researchers,
and
journalists
need
to
explore
and
make
data
requests
in
order
to
expand
a
shared
understanding
of
what
kinds
of
research
can
be
accomplished
with
platform
data,
and
to
develop
a
clearer
sense
of
what
kinds
of
data
are
on
the
menu
for
interrogation.
Many
of
these
programs
are
not
widely
publicized
-
in
some
cases
we
only
discovered
the
existence
of
a
program
after
multiple
efforts
to
contact
a
platform.
Through
various
efforts
to
catalog
the
programs
including
this
one,
more
information
is
now
available
to
find
and
apply
for
access.
The
experiences
with
these
public
data
programs
will
be
helpful
for
better
envisioning
non-public,
more
heavily
“vettedˮ
data
sharing
programs.
6I n
c o n c l u s i o n
This
report
has
tried
to
take
a
first
look
at
the
public
data
sharing
programs
of
some
of
the
worldʼs
largest
tech
platforms.
This
report
focuses
on
the
new
or
revised
data
sharing
offerings
released
in
the
context
of
the
EU
Digital
Services
Act
Article
40.12,
requiring
designated
services
to
share
publicly
accessible
data,
but
we
also
consider
data
sharing
more
broadly,
and
so
this
report
is
not
intended
to
be
an
assessment
of
compliance
with
DSA
40.12
programs.
We
find
that
reasonable
progress
has
been
made
to
increase
transparency
and
access
to
public
data
by
some
of
the
most
prominent
platforms,
but
that
significant
work
remains
to
effectively
enable
research
across
all
the
platforms
that
impact
society.
7Table
of
Contents
E x e c u t i v e
S u m m a r y
. . . . . . . . . . . . . . 


key: chroma:document
string_value:
heir
e xper iences.
Many
of
the
platforms
we
evaluated
reported
to
us
that
they
have
received
very
few
requests
for
data.
While
the
“vettedˮ
researcher
process
under
the
Digital
Services
Act
is
still
being
built,
the
public
data
sharing
programs
are
already
in
place.
Academic
researchers,
civil
society
researchers,
and
journalists
need
to
explore
and
make
data
requests
in
order
to
expand
a
shared
understanding
of
what
kinds
of
research
can
be
accomplished
with
platform
data,
and
to
develop
a
clearer
sense
of
what
kinds
of
data
are
on
the
menu
for
interrogation.
Many
of
these
programs
are
not
widely
publicized
-
in
some
cases
we
only
discovered
the
existence
of
a
program
after
multiple
efforts
to
contact
a
platform.
Through
various
efforts
to
catalog
the
programs
including
this
one,
more
information
is
now
available
to
find
and
apply
for
access.
The
experiences
with
these
public
data
programs
will
be
helpful
for
better
envisioning
non-public,
more
heavily
“vettedˮ
data
sharing
programs.
6I n
c o n c l u s i o n
This
report
has
tried
to
take
a
first
look
at
the
public
data
sharing
programs
of
some
of
the
worldʼs
largest
tech
platforms.
This
report
focuses
on
the
new
or
revised
data
sharing
offerings
released
in
the
context
of
the
EU
Digital
Services
Act
Article
40.12,
requiring
designated
services
to
share
publicly
accessible
data,
but
we
also
consider
data
sharing
more
broadly,
and
so
this
report
is
not
intended
to
be
an
assessment
of
compliance
with
DSA
40.12
programs.
We
find
that
reasonable
progress
has
been
made
to
increase
transparency
and
access
to
public
data
by
some
of
the
most
prominent
platforms,
but
that
significant
work
remains
to
effectively
enable
research
across
all
the
platforms
that
impact
society.
7Table
of
Contents
E x e c u t i v e
S u m m a r y
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2
Overview
....................................................................................................................................
2
Rankings
....................................................................................................................................
3
Key
Findings
..............................................................................................................................
4
Topline
Recommendations
........................................................................................................
5
In
conclusion
....................................................................................................................................
7
T a b l e
o f
C o n t e n t s
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
8
B a c k g r o u n d
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 


key: chroma:document
string_value:
k g r o u n d
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
9
Article
40
of
the
Digital
Services
Act
........................................................................................
9
A p p r o a c h
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1 0
Criteria
for
Researcher
Data
Access
Evaluation
.....................................................................
10
Detailed
Assessment
Measures
...............................................................................................
11
Platform
Evaluation
Strategy
...................................................................................................
14
O b s e r v a t i o n s
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 


key: chroma:document
string_value:
a t i o n s
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1 6
Quality
......................................................................................................................................
16
Accessibility
.............................................................................................................................
20
Security
and
Privacy
...............................................................................................................
22
R e c o m m e n d a t i o n s
f o r
p u b l i c
d a t a
s h a r i n g
p r o g r a m s
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2 6
For
Regulators
.........................................................................................................................
26
For
Platforms
...........................................................................................................................
26
For
Researchers
.......................................................................................................................
27
C h a l l e n g e s
a n d
L i m i t a t i o n s
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 


key: chroma:document
string_value:
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2 8
C o n c l u s i o n
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2 9
P l a t f o r m
A p p e n d i x
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 


key: chroma:document
string_value:
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
3 1
AliExpress
................................................................................................................................
32
Amazon
Store
..........................................................................................................................
33
Appleʼs
App
Store
....................................................................................................................
34
Bing
..........................................................................................................................................
35
Booking.com
............................................................................................................................
36
Meta:
Facebook
&
Instagram
...................................................................................................
37
Google
Maps
...........................................................................................................................
38
Google
Play
..............................................................................................................................
39
Google
Search
.........................................................................................................................
40
Google
Shopping
......................................................................................................................
41
LinkedIn
...................................................................................................................................
42
Pinterest
...................................................................................................................................
43
Snapchat
..................................................................................................................................
44
TikTok
......................................................................................................................................
45
Wikipedia
.................................................................................................................................
46
X/Twitter
..................................................................................................................................
47
YouTube
...................................................................................................................................
48
Zalando
....................................................................................................................................
49
8B a c k g r o u n d
A r t i c l e
4 0
o f
t h e
D i g i t a l
S e r v i c e s
A c t
Under
the
Digital
Services
Act
DSA,
the
European
Union
initially
designated
19
entities
as
Very
Large
Online
Platforms
VLOPs
or
Very
Large
Online
Search
Engines
VLOSEs
●
AliExpress
●
Amazon
Store
●
Appleʼs
App
Store
●
Bing
●
Booking.com
●
Facebook
●
Google
Maps
●
Google
Play
●
Google
Search
●
Google
Shopping
●
Instagram
●
LinkedIn
●
Pinterest
●
Snapchat
●
TikTok
●
Wikipedia
●
X
(formerly
Twitter)
●
YouTube
●
Zalando
Further
services
have
been
designated
since,
but
evaluating
those
additional
platforms
was
beyond
the
scope
of
this
research.
These
VLOP/SEs
are
subject
to
certain
obligations
under
Article
40
of
the
DSA
,
including
that
they
make
public
data
accessible
to
researchers
studying
“systemic
risks
to
the
European
Unionˮ
and
are
“independent
from
commercial
interests.ˮ
Section
12
of
Article
40
states:
“Providers
of
very
large
online
platforms
or
of
very
large
online
search
engines
shall
give
access
without
undue
delay
to
data,
including,
where
technically
possible,
to
real-time
data,
provided
that
the
data
is
publicly
accessible
in
their
online
interface
by
researchers,
including
those
affiliated
to
not
for
profit
bodies,
organisations
and
associations…ˮ
This
research
is
conducted
in
the
context
of
Article
40.12
being
in
force,
but
looks
more
broadly
at
what
access
to
public
data
is
available.
This
assessment
is
intended
to
be
understood
as
the
interpretation
of
the
research
community
needs,
and
c a n n o t
a n d
s h o u l d
n o t
be
interpreted
to
assess
compliance
under
the
Digitals
Services
Act.
9Approach
To
develop
a
standardized
methodology
for
evaluating
public
data
access
programs,
we
first
identified
the
primary
criteria
that
are
relevant
to
researchers
in
collaboration
with
a
network
of
stakeholders,
like
civil
society
research
organizations
and
independent
platform
accountability
experts.
We
have
defined
five
distinct
categories
of
measures
as
the
criteria
employed
throughout
the
evaluation.
C r i t e r i a
f o r
R e s e a r c h e r
D a t a
A c c e s s
E v a l u a t i o n
Qualit y
An
evaluation
of
the
quality
and
comprehensiveness
of
the
data
provided,
based
on
a
range
of
criteria
derived
from
real-world
data
usage
for
research
(see
below)
as
well
as
a
detailed
audit
of
the
public
data
visible
on
each
of
the
platforms.
The
grades
for
quality
will
help
policymakers
and
the
public
to
understand
the
breadth
of
the
data
they
are
sharing.
Ease
of
Use
An
evaluation
of
the
functionality
of
the
system
that
provides
data,
based
on
real-world
researcher
practices
and
concerns.
This
set
of
grades
will
examine
the
practical
usability
of
the
system
and
data
compared
to
expectations
and
best
practices.
These
grades
will
demonstrate
whether
or
not
the
tooling
and
limitations
provided
by
the
platforms
are
sufficient
to
actually
conduct
the
critical
research
protected
by
the
DSA.
A ccessibilit y
An
evaluation
of
the
processes
for
gaining
access
to
public
data
by
researchers
and
other
stakeholders.
These
grades
will
make
clear
whether
or
not
the
platforms
are
facilitating
broad,
diverse,
and
meaningful
access
to
the
community
that
DSA
Article
40.12
is,
in
our
view,
designed
to
serve.
T er ms
of
Use
An
evaluation
of
the
terms
under
which
researchers
can
use
the
data.
This
set
of
grades
will
look
both
at
how
well
the
terms
communicate
what
researchers
can
and
cannot
do,
as
well
as
compare
those
provisions
to
the
practical
concerns
researchers
have
when
conducting
and
publishing
research.
Pr iv ac y
and
Secur it y
An
evaluation
of
the
provisions
established
by
the
platforms
and
the
provisions
imposed
on
researchers
in
order
to
maintain
the
security
of
the
data
and
protect
the
privacy
of
individuals
who
create
or
are
referenced
in
the
data
available
for
research.
10D e t a i l e d
A s s e s s m e n t
M e a s u r e s
For
each
category,
we
developed
a
set
of
assessment
measures
in
collaboration
with
a
network
of
stakeholders
including
civil
society
researchers,
academics,
and
independent
platform
accountability
experts,
who
have
studied
these
online
platforms
and
made
use
of
the
various
methods
for
accessing
and
analyzing
public
platform
data.
For
each
measure,
we
developed
a
description,
guiding
questions,
and
a
specific
assessment
question
that
was
answered
for
each
platform.
Each
assessment
question
is
designed
to
be
answered
affirmatively
for
a
pro-researcher
outcome.
Q u a l i t y
C o v e r a g e
P u b l i c
Does
the
platform
provide
access
to
the
standard
public
data
that
is
visible
to
users?
C o v e r a g e
I n f e r r e d
Does
the
platform
provide
access
to
data
that
is
inferred
about
or
appended
to
users
and
content?
C o v e r a g e
A g g r e g a t e
Does
the
platform
provide
access
to
aggregate
data
about
users
and
content?
M e d i a
Does
the
platform
provide
access
to
media
content
for
analysis?
R e c e n c y
Does
the
platform
provide
real-time
data
on
activity?
H i s t o r i c a l
Does
the
platform
provide
full
historical
access
to
its
data?
G r a n u l a r i t y
Does
the
platform
provide
granular
access
to
individual
data
attributes?
C o m p l e t e n e s s
Does
the
platform
provide
access
to
removed
content?
C o n s i s t e n c y
Is
the
data
provided
by
the
platform
consistent
over
time?
C h r o n o l o g y
Does
the
data
provide
time-series
chronological
information?
E a s e
o f
U s e
11A P I
A c c 


key: chroma:document
string_value:
o m p l e t e n e s s
Does
the
platform
provide
access
to
removed
content?
C o n s i s t e n c y
Is
the
data
provided
by
the
platform
consistent
over
time?
C h r o n o l o g y
Does
the
data
provide
time-series
chronological
information?
E a s e
o f
U s e
11A P I
A c c e s s
Does
the
platform
provide
an
API
to
enable
researcher
access
to
data?
D a s h b o a r d
A c c e s s
Does
the
platform
provide
an
interactive
dashboard
to
enable
researcher
access
to
data?
D o w n l o a d
A c c e s s
Does
the
platform
provide
data
via
downloadable
archives?
S p e e d
R a t e
L i m i t i n g
Does
the
platform
enable
unlimited
frequency
of
requests
for
querying
the
data
access
system?
V o l u m e
R a t e
L i m i t i n g
Does
the
platform
provide
unlimited
access
to
the
volume
of
data
a
researcher
can
collect
and
analyze?
I n d e p e n d e n t
S t o r a g e
Does
the
platform
allow
the
researcher
to
extract
and
store
the
data
independently?
A c c e s s
R e s t r i c t i o n
Does
the
platform
allow
the
researcher
to
access
the
research
API
/
system
from
anywhere?
C o m b i n a b i l i t y
Does
the
platform
permit
joining
data
with
externally
sourced
data
or
tools?
S e a r c h
Does
the
platform
provide
keyword
search
and
filtering
capabilities?
B o o l e a n
L o g i c
Does
the
platform
provide
the
ability
to
apply
boolean
logic
to
search
and
filter
data?
D o c u m e n t a t i o n
Does
the
platform
provide
detailed
documentation
on
the
use
of
the
data
platform?
L a n g u a g e
A c c e s s i b i l i t y
Does
the
platform
provide
documentation
in
EU
local
languages
other
than
English?
F e e d b a c k
Does
the
platform
provide
a
mechanism
for
submitting
feedback
and
feature
requests
for
the
system?
S u p p o r t
Does
the
platform
provide
a
support
service
to
researchers?
A c c e s s i b i l i t y
12E l i g i b i l i t y
Are
all
types
of
researchers
eligible
for
access
to
the
researcher
data
offering?
E x c l u s i v i t y
Are
researchers
able
to
apply
without
unreasonable
demonstration
of
approvals
and
credentials?
G e o - l i m i t i n g
Are
researchers
able
to
apply
from
anywhere
in
the
world?
V e t t i n g
Are
the
researcher
vetting
requirements
fair
and
appropriate?
1
D a t a
A c c e s s
A f f o r d a b i l i t y
Is
the
access
to
the
data
provided
free
of
charge?
S e c u r i t y
R e q u i r e m e n t s
Are
the
security
requirements
for
data
access
reasonable?
2
I n f r a s t r u c t u r e
A f 


key: chroma:document
string_value:
d a b i l i t y
Is
the
access
to
the
data
provided
free
of
charge?
S e c u r i t y
R e q u i r e m e n t s
Are
the
security
requirements
for
data
access
reasonable?
2
I n f r a s t r u c t u r e
A f f o r d a b i l i t y
Is
it
affordable
to
maintain
the
infrastructure
required
to
work
with
the
data?
A p p l i c a t i o n
E a s e
Is
the
access
request
process
expected
to
be
completed
in
a
reasonable
amount
of
time?
R a p i d - r e s p o n s e
F e a s i b i l i t y
Can
rapid–response
research
be
conducted?
C o l l a b o r a t i o n
F r i e n d l y
Does
data
access
permit
data-sharing
within
and
across
institutions?
S i m p l i c i t y
Is
the
application
process
simple,
user-friendly,
and
easy?
A p p e a l s
Are
researchers
able
to
understand
and
appeal
decisions
around
access?
F l e x i b i l i t y
Is
it
possible
to
revise
or
extend
research
use-cases
on
existing
access
approvals?
2
Security
Requirements
were
judged
based
on
the
questions:
Does
the
platform
require
levels
of
security which
are
not
easily
maintained
by
individual
researchers?
Does
the
platform
require
the
use
of
speciﬁc tools
or
processes?
Does
the
platform
require
processes
or
procedures
which
negatively
impact
the research
process?
1
Vetting
requirements
were
judged
based
on
the
questions:
Are
the
requirements
for
approval
onerous
or limiting
in
ways
that
make
it
diﬃcult
to
get
access?
Are
IRB
approvals
required
in
order
to
get
access?
13L o n g e v i t y
Is
the
researcher
access
available
for
a
significant
and
reasonable
period
of
time?
T e r m s
o f
U s e
F a i r n e s s
Are
the
terms
of
use
reasonable
given
the
research
landscape?
C l a r i t y
Are
the
terms
of
use
easy
to
review
and
comprehend?
A u t o n o m y
Do
the
terms
ensure
researcher
autonomy
and
independence?
T e c h n i c a l
L i m i t a t i o n s
Do
the
terms
ensure
there
are
no
significant
technical
limitations
that
could
impact
research?
P r i v a c y
a n d
S e c u r i t y
P e r s o n a l
D a t a
P r o t e c t i o n
Does
the
data
access
ensure
adequate
protection
of
personal
data?
A g g r e g a t i o n
P r i v a c y
Are
data
aggregation
limits
sufficient
to
protect
against
re-indentification?
U s e r
P r i v a c y
E x p e c t a t i o n s
Does
the
data
access
uphold
our
inferred
3
user
expectations
about
public
and
private
forms
of
data?
D a t a
S e c u r i t y
Does
the
data
access
system
provide
adequate
security
protocols?
4
O v e r s i g h t
Is
there
sufficient
oversight
of
researcher
activity
to
ensure
compliance
with
security
and
privacy
protocols?
P l a t f o r m
E v a l u a t i o n
S t r a t e g y
To
answer
the
questions,
we
reviewed
documentation
available
on
the
VLOPsʼ
and
VLOSEsʼ
websites
(e.g.,
terms
of
use,
researcher
program
descriptions,
researcher
program
applications,
API
documentation,
etc.)
and
documented
our
findings
in
an
Airtable
database.
We
referenced
existing
research
into
data
access
programs,
including
the
Platform
Transparency
Tools
Tracker
,
launched
by
Anna
Lenhart
and
Annika
4
Data
security
was
assessed
by
reviewing
the
policies
described
and
applied,
and
where
applicable,
the technical
requirements
associated
with
the
data
access.
3
We
inferred
user
expectations
about
privacy
subjectively
by
contemplating
for
a
given
platform
surface 


key: chroma:document
string_value:
a
S e c u r i t y
Does
the
data
access
system
provide
adequate
security
protocols?
4
O v e r s i g h t
Is
there
sufficient
oversight
of
researcher
activity
to
ensure
compliance
with
security
and
privacy
protocols?
P l a t f o r m
E v a l u a t i o n
S t r a t e g y
To
answer
the
questions,
we
reviewed
documentation
available
on
the
VLOPsʼ
and
VLOSEsʼ
websites
(e.g.,
terms
of
use,
researcher
program
descriptions,
researcher
program
applications,
API
documentation,
etc.)
and
documented
our
findings
in
an
Airtable
database.
We
referenced
existing
research
into
data
access
programs,
including
the
Platform
Transparency
Tools
Tracker
,
launched
by
Anna
Lenhart
and
Annika
4
Data
security
was
assessed
by
reviewing
the
policies
described
and
applied,
and
where
applicable,
the technical
requirements
associated
with
the
data
access.
3
We
inferred
user
expectations
about
privacy
subjectively
by
contemplating
for
a
given
platform
surface whether
or
not
we
would
assume
such
data
would
be
seen
by
people
other
than
those
we
intended.
For example,
we
assume
a
public
TikTok
video
can
be
seen
by
the
world,
but
our
comments
on
a
Facebook friend’s
personal
photo
would
not.
14Springsteel
and
maintained
by
the
Institute
for
Data,
Democracy
&
Politics
at
George
Washington
University.
We
also
reached
out
to
each
VLOP/SE
describing
our
research
and
requesting
additional
information.
S c o r i n g
We
developed
a
strategy
for
scoring
each
platform
on
each
measure
using
a
scale
from
05,
based
on
the
relative
extent
to
which
they
met
our
criteria.
A
score
of
zero
indicates
the
criterion
was
not
met;
a
score
of
five
indicates
the
criterion
was
fully
met.
A
score
of
one
through
four
indicates
the
criterion
was
partially
met.
In
many
cases,
platforms
score
0
for
a
measure
because
they
do
not
offer
a
program
or
service,
or
because
it
is
impossible
to
measure
what
they
offer
at
this
time.
We
internally
mark
scores
that
are
not
measurable
in
order
to
evaluate
averages
with
and
without
these
measures,
however
the
final
averages
and
ranking
include
every
score
including
those
which
were
“not
applicable.ˮ
Finally,
in
several
cases
it
was
necessary
to
infer
based
on
context
scores
where
we
know
enough
about
the
programs
and
the
data,
and
felt
this
approach
more
accurately
reflected
relative
value
than
using
an
absolute
determination
based
on
public
information.
Thus
on
the
whole,
we
try
to
give
a
fair
representation
of
the
relative
value
on
these
measures
between
platforms
even
though
the
scores
were
determined
subjectively.
15Observations
Our
assessment
of
the
VLOP/SEs
yielded
key
insights
into
the
different
platformsʼ
approaches
to
making
publicly
available
data
accessible
to
the
research
community.
Q u a l i t y
16T i m e
s e r i e s
d a t a
i s
m i s s i n g
f r o m
v i r t u a l l y
a l l
p r o v i d e r s
Researchers
need
access
to
information
about
what
has
happened
over
time
to
understand
trends
and
spikes
in
interest
in
subjects,
and
to
characterize
the
growth
in
reach
and
influence
of
problematic
actors.
Previously,
CrowdTangle
provided
this
data
about
Facebook
and
Instagram,
but
the
Meta
Content
Library
has
lost
this
feature,
and
none
of
the
other
platforms
except
Wikipedia
maintain
such
change-over-time
data.
Bingʼs
search
API
appears
to
provide
search
volume
over
time
similar
to
Google
Trends
data.
C o n s i s t e n c y
i n
t h e
d a t a
o v e r
t i m e
i s
d i f f i c u l t
t o
v e r i f y
Researchers
need
to
trust
the
data
they
will
use
when
attempting
to
publish,
and
almost
none
of
the
providers
make
clear
guarantees
about
the
consistency
of
the
data.
Meta
has
released
a
new
tool
called
the
Content
Library,
which
has
documentation
that
specifically
acknowledges
that
the
data
it
returns
will
not
be
consistent
from
day
to
day
or
truly
representative
of
what
is
on
the
platform
for
a
given
search
5
.
5
https://developers.facebook.com/docs/content-library-and-api/content-library/#additional-information
17E a s e
o f
U s e
T h e r e
a r e
n o
s i g n i f i c a n t
a c c e s s
r e s t r i c t i o n s
e x c e p t
f o r
M e t a
Access
restrictions
are
minimal
across
the
board,
except
for
Metaʼs
offering.
Most
providers
make
it
easy
to
connect
to
the
data
regardless
of
where
you
are
and
do
not
require
special
software
or
strategies
for
using
the
data.
Metaʼs
Content
Library
is
a
significant
exception
because
it
requires
using
both
a
VPN
to
connect
and
applies
significant
limitations
on
how
to
collect
and
analyze
data
from
their
API,
such
as
only
showing
the
first
1000
results
in
the
dashboard,
and
automatically
deleting
data
from
the
researchersʼ
research
tool
every
30
days.
18A P I s
a r e
t h e
p r i m a r y
m e c h a n i s m
o f
d a t a
a c c e s s
APIs
are
widespread
with
the
highest
ranking
providers,
and
are
the
ideal
mechanism
for
making
data
accessible
to
researchers
in
a
systematic
manner,
but
require
some
technical
skill
to
leverage.
D a s h b o a r d s
a r e
a n
u n m e t
n e e d
Dashboards
for
public
data
do
not
exist
for
any
services
except
Meta.
This
kind
of
accessible
exploratory
tool
is
widely
used
by
non-technical
and
non-academic
researchers
at
newsrooms
and
NGOs.
While
such
tools
are
expensive
to
build
and
maintain,
they
would
significantly
expand
usability,
especially
in
support
of
real-time,
rapid-response,
and
targeted
research.
A
partial
exception
exists
for
Wikipedia,
because
the
platform
itself
is
effectively
an
exploratory
dashboard
in
which
all
the
data
and
history
is
explorable
on
the
web.
C u s t o m e r
s u p p o r t
f o r
r e s e a r c h e r s
i s
s t i l l
i n
i t s
i n f a n c y
Documentation,
feedback
systems,
and
technical
support
are
extremely
limited
overall.
The
major
providers
do
offer
some
of
these
components,
though
effectively
only
in
English,
and
not
in
the
other
major
languages
spoken
in
the
EU.
R a t e - l i m i t s
m a y
s i g n i f i c a n t l y
i m p e d e
r e s e 


key: chroma:document
string_value:
t s
i n f a n c y
Documentation,
feedback
systems,
and
technical
support
are
extremely
limited
overall.
The
major
providers
do
offer
some
of
these
components,
though
effectively
only
in
English,
and
not
in
the
other
major
languages
spoken
in
the
EU.
R a t e - l i m i t s
m a y
s i g n i f i c a n t l y
i m p e d e
r e s e a r c h
The
majority
of
programs
have
significant
rate
limitations
for
the
volume
of
data
and
speed
to
access
it.
While
the
restrictions
may
be
intended
to
prevent
abuse
of
these
systems,
the
measures
are
impractical
and
significantly
limit
the
potential
for
researchers
to
carry
out
larger-scale
and
longitudinal
analysis,
which
by
their
nature
require
large
volumes
of
data
in
order
to
identify
systemic
risks.
19A c c e s s i b i l i t y
P r o g r a m s
a r e
n o t
d e s i g n e d
f o r
e m e r g i n g
c r i s e s
o r
i n f o r m a t i o n
s h o c k s
The
current
structure
of
the
programs
do
not
appear
to
enable
rapid-response
research
that
emerges
from
current
events.
For
example,
if
a
researcher
wants
to
monitor
narratives
and
trends
unfolding
in
real-time
around
the
conflict
in
Gaza
to
identify
the
prevalence
of
hate
speech
6
,
or
if
they
wanted
to
understand
the
prevalence
of
foreign
disinformation
in
the
conversation
about
the
European
farmers'
protests
7
,
the
research
application
process
would
significantly
hinder
rapid-response
monitoring
on
nearly
all
7
https://www.politico.eu/article/europe-farmer-protest-russia-war-propaganda/
6
https://www.nytimes.com/2023/11/15/technology/hate-speech-israel-gaza-internet.html
20providers.
Users
with
existing
access
could
leverage
that
access
to
pivot
to
rapid
response,
but
might
risk
violating
their
agreements
which
were
developed
and
signed
in
the
context
of
other
specific
areas
of
research.
T e r m s
o f
U s e
T e r m s
a r e
g e n e r a l l y
f a i r
The
terms
of
use
for
almost
all
programs–where
they
exist–are
reasonable
and
straightforward.
They
do
not
generally
restrict
autonomy,
with
the
mild
exception
of
TikTok,
which
requires
pre-publication
review.
R e s e a r c h
s c a l e
m a y
b e
c o m p r o m i s e d
b y
t e c h n i c a l
l i m i t s
i m p o s e d
b y
t h e
t e r m s
o f
u s e
Technical
limitations
specified
in
the
terms
that
relate
to
data
retention
could
create
various
issues
that
impede
research,
however
those
limitations
are
driven
at
least
in
part
21by
legitimate
privacy
concerns.
The
practical
challenges
created
by
legal
terms
that
limit
the
volume,
speed
of
access,
and
scraping
of
data
can
significantly
impact
the
quality
and
diversity
of
research
that
can
be
produced.
S e c u r i t y
a n d
P r i v a c y
P r i v a c y
a p p e a r s
t o
b e
g e n e r a l l y
p r o t e c t e d
Most
of
the
data
access
programs
appear
to
maintain
our
inferred
user
expectations
of
privacy
because
they
only
grant
access
to
data
that
is
publicly
available.
However,
those
expectations
are
somewhat
ambiguous
when
it
comes
to
public
data
about
comments,
which
is
made
available
from
YouTube,
TikTok,
and
Meta.
S e c u r i t y
i s
s e l f - r e p o r t e d
a n d
p o t e n t i a l l y
p e r f o r m a t i v e
While
many
of
the
programs
require
researchers
to
provide
information
about
data
security
and
related
privacy
protections,
there
appears
to
be
almost
no
mechanism
for
22auditing
or
enforcement,
except
with
YouTube.
In
addition,
Meta
maintains
control
over
the
research
infrastructure
which
largely
eliminates
the
need
for
verification.
G e n e r a l
Data
Access
Programs
come
in
four
flavors
Platforms
have
exercised
significantly
differing
strategies
in
making
public
data
accessible
to
researchers.
As
we
discuss
below,
some
programs
afford
researchers
significantly
more
access
than
others,
and
in
some
cases
–
as
with
data
requests
–
itʼs
challenging
to
assess
precisely
how
expansive
access
is.
Our
work
identified
four
types
of
access:
O v e r v i e w
P l a t f o r m s
F or mal
Pr ogr ams
These
platforms
have
established
new,
formal
programs
to
service
researchers
with
access
to
APIs,
dashboards,
and
other
resources
created
for
the
purpose
of
research
under
Section
40.12
of
the
DSA.
A l i E x p 


key: chroma:document
string_value:
r f o r m a t i v e
While
many
of
the
programs
require
researchers
to
provide
information
about
data
security
and
related
privacy
protections,
there
appears
to
be
almost
no
mechanism
for
22auditing
or
enforcement,
except
with
YouTube.
In
addition,
Meta
maintains
control
over
the
research
infrastructure
which
largely
eliminates
the
need
for
verification.
G e n e r a l
Data
Access
Programs
come
in
four
flavors
Platforms
have
exercised
significantly
differing
strategies
in
making
public
data
accessible
to
researchers.
As
we
discuss
below,
some
programs
afford
researchers
significantly
more
access
than
others,
and
in
some
cases
–
as
with
data
requests
–
itʼs
challenging
to
assess
precisely
how
expansive
access
is.
Our
work
identified
four
types
of
access:
O v e r v i e w
P l a t f o r m s
F or mal
Pr ogr ams
These
platforms
have
established
new,
formal
programs
to
service
researchers
with
access
to
APIs,
dashboards,
and
other
resources
created
for
the
purpose
of
research
under
Section
40.12
of
the
DSA.
A l i E x p r e s s
G o o g l e
S e a r c h
F a c e b o o k
I n s t a g r a m
T i k T o k
L i n k e d I n
Existing
APIs
and
A ccess
Pr ogr ams
These
platforms
have
previously
established
APIs
and
data
access
programs
that
make
public
data
available.
Bing,
Wikipedia,
X,
and
YouTube
have
elected
to
make
these
APIs
available
to
eligible
researchers
under
Section
40.12
of
the
DSA.
B i n g
G o o g l e
M a p s
W i k i p e d i a
X
 T w i t t e r )
Y o u T u b e
P er mission
t o
Scr ape
These
platforms
explicitly
or
implicitly
allow
the
scraping
of
public
data
by
researchers.
Google
Play,
Shopping,
and
Search
permit
“limited
scraping.ˮ
The
customer
terms
of
service
Section
A14.
Intellectual
Property
Rights)
for
Booking.com
state,
“Youʼre
not
allowed
to
monitor,
copy,
scrape/crawl,
download,
reproduce,
or
otherwise
use
anything
on
our
Platform
for
any
commercial
purpose
without
written
permission
of
Booking.com
or
its
licensors.ˮ
Given
that
the
access
granted
to
A m a z o n
S t o r e
8
G o o g l e
P l a y
G o o g l e
S h o p p i n g
B o o k i n g . c o m
P i n t e r e s t
9
9
Pinterest
conﬁrmed
via
email
that
they
“would
allow
scraping
by
a
researcher
who
was
qualiﬁed
under DSA
Art.
40(12)”
8
Amazon
has
conﬁrmed
to
our
research
team
via
email
that
“using
industry-standard,
research-speciﬁc tools
to
collect
publicly
available
data”
is
not
prohibited.
23public
data
under
Article
40
of
the
Digital
Services
Act
requires
researchers
to
be
“independent
from
commercial
interests,ˮ
it
appears
that
DSA-eligible
researchers
are
permitted
to
scrape
the
platform.
Dat a
R equest s
These
platforms
provide
a
way
for
eligible
researchers
to
make
specific
requests
for
public
data,
which
the
platform
then
provides
(e.g.,
in
a
.csv
file).
Researchers
are
not
given
broad
access
to
public
data;
rather,
they
must
describe
the
kind
of
public
data
their
research
requires,
and
the
platform
will
respond
directly
to
the
request.
These
programs
currently
lack
significant
documentation
about
the
format
data
will
be
provided
in
or
specifics
about
what
data
may
be
made
available.
B o o k i n g . c o m
P i n t e r e s t
S n a p c h a t
None
Two
VLOPs
do
not
appear
to
have
made
any
effort
to
provide
access
to
public
data.
As
of
the
time
of
writing,
we
have
not
been
able
to
identify
any
formal
programs,
specifically
relevant
APIs,
or
other
data
offerings
from
Appleʼs
App
Store
10
or
Zalando
11
.
A p p l e
A p p
S t o r e
Z a l a n d o
Programs
are
new
and
untested
Many
of
the
programs
and
other
offerings
made
available
by
VLOPs
and
VLOSEs
are
new
and
have
not
been
used
extensively
by
the
research
community.
At
least
two
platforms
–
Snapchat
and
Pinterest
–
said
that
no
researchers
had
made
use
of
their
programs
as
of
early
2024
when
asked.
While
our
work
sought
to
test
these
programs
and
offerings,
we
were
only
able
to
gain
access
to
a
few
of
them,
namely
the
Meta
Content
Library,
Bingʼs
researcher
program,
the
YouTube
API,
and
Wikipedia.
Furthermore,
many
researchers
have
only
just
begun
using
the
programs
themselves,
or
are
in
the
process
of
applying
to
them.
These
programs
have
not
faced
extensive
scrutiny
by
researchers
at
this
point.
The
true
utility
of
these
programs
will
become
clearer
as
a
larger
diversity
of
researchers
test
the
data
access
offerings
using
different
methods
and
exploring
a
variety
of
questions
and
problems.
11
Zalando’s
legal
notice
page
indicates
that
researchers
can
contact
them
for
data
access,
but
provides
no information
about
the
oﬀering
on
their
website.
10
Apple
responded
to
our
inquiry,
stating
that
DSA-eligible
researchers
can
contact
the
platform
to
receive publicly
accessible
data.
24Programs
are
changing
During
the
course
of
our
research,
many
VLOP/SEs
stood
up
new
programs/data
access
offerings,
or
changed
their
offerings.
This
necessitated
revisiting
our
grading
as
programs
and
applications
changed.
O u r
g r a d e s
r e f l e c t
p l a t f o r m
o f f e r i n g s
a s
o f
M a y
2 0 2 4
.
Programs
donʼt
explain
what
they
offer
Apart
from
the
differences
between
program
offerings,
VLOP/SEs
vary
widely
in
the
types
of
documentation
and
support
they
make
available
to
researchers.
In
general,
programs
that
offer
APIs
tend
to
make
more
extensive
documentation
available
to
researchers
to
describe
the
types
of
data
available
and
how
to
use
it.
Platforms
that
require
researchers
to
make
specific
data
requests
offer
very
little
information
about
what
data
they
will
share
(beyond
“public
dataˮ)
or
how
the
data
will
be
formatted.
This
results
in
“cart
before
the
horseˮ
research
planning,
as
researchers
cannot
understand
what
is
available.
This
makes
it
challenging
to
formulate
precise
research
questions
before
applying
for
data
access.
This
may
discourage
researchers
from
using
the
programs.
There
is
currently
no
formal
definition
of
“publicly
accessible
dataˮ
which
allows
platforms
to
remain
ambiguous
about
how
they
define
the
“public
dataˮ
offered.
Programs
lack
tools
for
those
without
technic al
skills
Few
platforms
offer
dashboards
or
other
tools
that
would
allow
a
researcher
without
any
technical
skills
to
view
or
analyze
data.
Meta,
a
notable
exception,
introduced
the
Meta
Content
Library
and
API
in
2023,
which
includes
tools
to
search
and
view
data
via
keywords
and
“producerˮ
lists.
In
2024,
Meta
added
the
ability
for
researchers
to
download
a
selection
of
publicly
available
data
from
sources
that
have
significant
public
followings
(pages
with
more
than
15,000
likes
and
profiles
with
greater
than
25,000
followers).
Loss
of
CrowdTangle
CrowdTangle,
a
research
platform
from
Meta
that
will
be
discontinued
as
of
August
2024,
has
served
as
an
example
of
a
relatively
robust
data
access
tool
that
can
be
used
extensively
by
technical
and
non-technical
researchers
alike.
Unfortunately,
the
Meta
Content
Library
MCL
does
not
yet
offer
the
same
functionality
and
in
some
cases
level
of
granularity
as
CrowdTangle.
While
Metaʼs
Content
Library
demonstrates
the
most
extensive
effort
to
provide
researcher-specific
tooling,
and
adds
several
new
types
of
data
that
were
previously
unavailable
to
researchers
in
CrowdTangle,
the
system
lacks
features
and
data
that
were
previously
available.
25Recommendations
for
public
data
sharing
programs
F o r
R e g u l a t o r s
1.
R e g u l a t o r s
s h o u l d
o f f e r
a
f o r m a l
d e f i n i t i o n
o f
“ p u b l 


key: chroma:document
string_value:
o r s
1.
R e g u l a t o r s
s h o u l d
o f f e r
a
f o r m a l
d e f i n i t i o n
o f
“ p u b l i c
d a t a ˮ
in
regulatory
guidance
that
platforms,
researchers,
and
regulators
can
reference.
2.
R e g u l a t o r s
s h o u l d
r e q u i r e
p l a t f o r m s
t o
p u b l i s h
s p e c i f i c a t i o n s
a n d
d o c u m e n t a t i o n
for
their
researcher
access
programs.
3.
R e g u l a t o r s
s h o u l d
e x p a n d
r e s e a r c h e r
a c c e s s
n e e d s
to
support
exploratory
research
without
a
pre-defined
research
question
or
hypothesis,
in
relation
to
systemic
risks.
4.
R e g u l a t o r s
s h o u l d
a l l o w
o r g a n i z a t i o n - b a s e d
a c c e s s
to
research
programs,
rather
than
project-based
access
to
enable
researchers
to
continually
monitor
and
probe
data
for
new
questions/problems.
5.
R e g u l a t o r s
s h o u l d
r e q u i r e
p l a t f o r m s
t o
c a p t u r e
a n d
p u b l i s h
t h e
n u m b e r
o f
r e s e a r c h e r
d a t a
a c c e s s
r e q u e s t s
t h e y
r e c e i v e
,
the
number
they
approve,
and
provide
guidance
on
their
standards
for
approval.
6.
R e g u l a t o r s
s h o u l d
e s t a b l i s h
a
w a y
o f
i n c l u d i 


key: chroma:document
string_value:
h e y
r e c e i v e
,
the
number
they
approve,
and
provide
guidance
on
their
standards
for
approval.
6.
R e g u l a t o r s
s h o u l d
e s t a b l i s h
a
w a y
o f
i n c l u d i n g
t h e
b e h a v i o r
o f
a l g o r i t h m i c
r e c o m m e n d e r
s y s t e m s
in
the
concept
of
public
data
so
that
researchers
can
request
access
to
the
aggregate
outputs
of
algorithmic
recommendation
systems
to
understand
which
public
data
users
see.
7.
R e g u l a t o r s
s h o u l d
c l a r i f y
t h e
l e g i t i m a c y
o f
s c r a p i n g
as
a
means
of
accessing
public
data.
Several
major
platforms
already
permit,
either
implicitly
or
explicitly,
data
scraping
as
a
form
of
data
access
for
research
purposes.
Implicit
permission
to
scrape,
as
we
have
received
for
instance
over
email
from
some
providers,
is
likely
not
sufficient
reassurance
for
most
researchers.
Legal
ambiguities
remain
and
privacy
concerns
in
the
practice
of
scraping
are
therefore
not
systematically
addressed.
8.
R e g u l a t o r s
s h o u l d
p r o v i d e
f u n d i n g
t o
s u p p o r t
and
encourage
researchers'
initial
exploration
and
testing
of
these
programs.
F o r
P l a t f o r m s
9.
P l a t f o r m s
s h o u l d
p u b l i s h
m o r e
e x t e n s i v e
d o c u m e n t a t i o n
about
what
data
is
available
to
researchers
and
how
that
data
will
be
provided.
10.
P l a t f o r m s
s h o u l d
p r o v i d e
s o m e
w a y
o f
a u d i t i n g
w h a t
i s
“ p u b l i c l y
a v a i l a b l e ˮ
within
a
given
platform
by
distributing
data
schemas,
surface
audits,
or
other
means
that
enable
researchers
and
regulators
to
have
a
clear
and
complete
understanding
of
what
the
typical
user
can
see
on
the
platform.
11.
P l a t f o r m s
s h o u l d
c r e a t e
o f f e r i n g s
f o r
n o n - t e c h n i c a l
r e s e a r 


key: chroma:document
string_value:
r m s
s h o u l d
c r e a t e
o f f e r i n g s
f o r
n o n - t e c h n i c a l
r e s e a r c h e r s
,
such
as
dashboards
or
downloadable
datasets
for
non-programmatic
analysis.
2612.
P l a t f o r m s
s h o u l d
e n a b l e
a n d
e n c o u r a g e
t h e
c r e a t i o n
o f
t h i r d - p a r t y
t o o l i n g
such
as
dashboards,
data-donation
repositories,
and
historical
archives
to
increase
accessibility
and
capacity
for
collaborative
research.
13.
P l a t f o r m s
s h o u l d
p r o v i d e
e a s y - t o - f i n d
o r
d i r e c t
l i n k s
t o
t h e i r
D S A - s p e c i f i c
r e s e a r c h e r
d a t a
a c c e s s
p r o g r a m s .
14.
P l a t f o r m s
s h o u l d
m a i n t a i n
a n d
e n a b l e
a c c e s s
t o
t i m e - s e r i e s
d a t a
about
content
engagement,
account
growth,
and
any
other
relevant
attributes
that
change
over
time
and
are
necessary
for
monitoring
systemic
risks
15.
P l a t f o r m s
s h o u l d
d e v e l o p
m e c h a n i s m s
f o r
d o c u m e n t i n g
a n d
v a l i d a t i n g
t h e
c o n s i s t e n c y
a n d
a c c u r a c y
o f
d a 


key: chroma:document
string_value:
e n t i n g
a n d
v a l i d a t i n g
t h e
c o n s i s t e n c y
a n d
a c c u r a c y
o f
d a t a
o v e r
t i m e .
16.
P l a t f o r m s
s h o u l d
d e v e l o p
m o r e
r o b u s t
r e s e a r c h e r
r e s o u r c e s
for
both
applying
for
access
and
using
data.
This
includes
documenting
the
anticipated
wait
time
for
applications,
providing
examples
of
data
privacy
and
security
protocols
to
comply
with,
and
providing
technical
customer
support
and
feedback
tools
for
the
data
access
tools
themselves.
17.
P l a t f o r m s
s h o u l d
i n c r e a s e
r a t e - l i m i t s
and/or
provide
mechanisms
for
securing
exceptions
to
the
limits
for
specific
use-cases.
18.
P l a t f o r m s
s h o u l d
c r e a t e
m u l t i - l a n g u a g e
d o c u m e n t a t i o n .
19.
P l a t f o r m s
s h o u l d
c r e a t e
a
p a t h
f o r
r a p i d - r e s p o n s e
a c c e s s
during
moments
that
demand
action.
20.
P l a t f o r m s
s h o u l d
d e v e l o p
a n d
d o c u m e n t
p r o c e s s e s
f o r
r e v i e w i n g
a n d
a u d i t i n g
r e s e a r c h e r s ʼ
s e c u r i t y
a n d
p r i v a c y
p r o t o c o l s
in
ways
that
are
material
and
verifiable,
but
do
not
feel
disproportionately
burdensome.
F o r
R e 


key: chroma:document
string_value:
i n g
r e s e a r c h e r s ʼ
s e c u r i t y
a n d
p r i v a c y
p r o t o c o l s
in
ways
that
are
material
and
verifiable,
but
do
not
feel
disproportionately
burdensome.
F o r
R e s e a r c h e r s
21.
R e s e a r c h e r s
s h o u l d
a p p l y
t o
a n d
u s e
t h e s e
p u b l i c
d a t a
p r o g r a m s
to
improve
understanding
of
offerings,
document
and
report
on
challenges
of
applying
and
using
data,
and
participate
in
field-wide
surveys
to
increase
shared
awareness.
22.
R e s e a r c h e r s
s h o u l d
s h a r e
b e s t
p r a c t i c e s
f o r
m e e t i n g
p r i v a c y
a n d
s e c u r i t y
r e q u i r e m e n t s
for
data
access
to
reduce
the
burden
on
researchers
who
are
not
familiar
with
or
donʼt
have
capacity
to
develop
these
protocols.
23.
R e s e a r c h e r s
s h o u l d
d e v e l o p
a
s h a r e d
p u b l i c
l i s t
o f
r e s e a r c h e r
d a t a
a c c e s s
u s e - c a s e s
that
represent
edge-cases
not
currently
supported
by
platform
programs.
24.
R e s e a r c h e r s
s h o u l d
i d e n t i f y
a n d
d o c u m e n t
t i m e - s e n s i t i v e
r a p i d - r e s p o n s e
m o m e n t s
that
would
benefit
from
researcher
data
access
that
are
not
possible
under
the
current
programs.
25.
N o n - a c a d e m i c a l l y
a f f i l i a 


key: chroma:document
string_value:
a p i d - r e s p o n s e
m o m e n t s
that
would
benefit
from
researcher
data
access
that
are
not
possible
under
the
current
programs.
25.
N o n - a c a d e m i c a l l y
a f f i l i a t e d
a n d
n o n - E U - b a s e d
r e s e a r c h e r s
s h o u l d
p a r t n e r
w i t h
E U - b a s e d
a c a d e m i c
i n s t i t u t i o n s
t o
p u r s u e
r e s e a r c h
related
to
systemic
risks
to
exemplify
the
value
of
global
research
collaboration,
especially
those
in
Global
Majority
context.
27C h a l l e n g e s
a n d
L i m i t a t i o n s
We
wish
to
acknowledge
some
significant
challenges
we
faced
in
our
effort
to
develop
this
scorecard.
Understanding
these
limitations
is
necessary
context
for
how
the
current
set
of
scores
can
be
used
responsibly,
and
should
also
guide
future
efforts
to
expand
this
work
P r o g r a m
A c c e s s
We
were
not
able
to
access
most
of
the
programs
themselves,
because
of
the
various
limitations
imposed
by
the
applications
for
access,
including
geography,
specific
research
requirements
associated
with
systemic
risks,
academic
credentials,
and
technical
specifications
for
data
security
and
privacy.
This
means
that
our
scores
are
based
primarily
on
documentation,
public
statements,
feedback
from
researchers
who
currently
possess
or
have
applied
to
get
access,
and
in
some
cases,
inferences
based
on
general
knowledge
of
the
programs
and
platforms.
As
of
May
1,
2024,
few
other
researchers
have
secured
access
to
these
programs,
which
has
limited
our
ability
to
get
detailed
information
about
their
experiences
with
usability,
completeness,
consistency,
the
timing
for
application
reviews,
and
other
factors.
We
anticipate
that
forthcoming
research,
for
example
as
led
by
the
Coalition
for
Independent
Technology
Research
will
provide
a
much
larger
sample
of
researchersʼ
experiences
that
will
shed
light
on
these
issues.
D o c u m e n t a t i o n
The
current
state
of
researcher
access
programs
generally
suffer
from
limited
or
non-existent
documentation.
In
addition,
for
many
of
these
programs,
the
information
and
application
forms
that
do
exist
are
buried
and
difficult
to
find.
As
a
result,
it
is
impossible
to
verify
if
what
we
found
is
comprehensive
and
accurate.
In
many
cases,
the
information
about
researcher
data
access
programs
linked
to
the
DSA
obligations
live
on
separate
sites
without
good
SEO
or
links
to
the
top-level
of
the
terms,
trust
and
safety,
or
other
transparency
resources.
After
we
developed
draft
evaluations
and
shared
their
scores
for
comment,
more
platforms
did
respond
to
provide
additional
information
and
context.
T i m i n g
Over
the
course
of
this
period,
several
programs
and
application
forms
emerged
that
were
not
available
when
we
first
began.
In
addition,
programs
changed
over
the
course
of
this
research,
offering
new
information,
or
announcing
enhanced
features.
The
new
releases
are
often
un-dated
making
it
difficult
to
determine
when
they
were
released
and/or
changed.
We
have
made
our
best
effort
to
revise
our
grades
and
collect
additional
evidence,
but
because
these
programs
are
actively
under
development,
some
findings
may
be
outdated
upon
publication.
28P l a t f o r m
D i s t i n c t i o n s
The
19
VLOP/SEs
vary
dramatically
from
one
another.
Several
are
retail
marketplaces
for
physical
and
virtual
goods
and
services
Amazon,
Apple
App
Store,
Booking,
Google
Play,
Zalando)
others
are
mainstream
social
media
platforms
Facebook,
Instagram,
TikTok,
X,
YouTube),
some
are
more
private
social
networks
LinkedIn,
Snapchat)
and
others
are
more
complex
services
Bing,
Google
Maps,
Google
Search).
As
a
result,
it
is
difficult
to
evaluate
what
constitutes
“publicˮ
data
on
the
platforms,
and
to
compare
their
offerings
to
one
another.
While
this
baseline
is
a
meaningful
start,
future
work
in
this
space
should
likely
separate
these
distinct
types
of
platforms
from
one
another
for
analysis.
L e s s o n s
L e a r n e d
Our
initial
set
of
measures
and
categories
of
criteria
for
evaluation
we
developed
with
care
and
feedback
from
the
community
of
stakeholders
who
will
use
this
data
access.
However,
after
attempting
to
evaluate
the
platforms
on
these
measures,
it
became
clear
that
although
we
wish
to
know
the
answers
to
these
questions,
it
is
not
feasible
to
identify
those
answers.
This
was
true
for
various
measures,
but
particularly
the
Security
and
Privacy
questions,
as
well
as
areas
where
we
start
from
a
hypothetical
expectation
for
data
access,
including
the
Coverage
of
Inferred
Data,
the
Rapid
Response
Feasibility,
and
Aggregate
Data.
B r o a d
S c o p e
There
are
some
key
aspects
of
these
platforms
which
are
beyond
the
scope
of
this
methodology.
Algorithmic
recommender
systems
are
not
explicitly
mentioned
under
DSA
40.12,
but
represent
a
possible
factor
contributing
to
systemic
risks,
for
instance
to
civic
discourse,
electoral
processes,
or
public
security.
These
features
straddle
the
line
between
what
can
be
considered
“public
dataˮ
and
proprietary
systems.
The
results
of
algorithmic
recommenders
are
frequently
visible
as
public
data,
but
their
risk
and
impact
can
only
be
evaluated
in
aggregate
(e.g.,
how
many
people
are
recommended
toxic
content
based
on
behavior).
Currently,
these
platforms
do
not
provide
researchers
access
to
information
about
algorithmic
recommenders,
so
this
research
does
not
attempt
to
address
this
critical
area.
This
will
likely
be
an
area
for
DSA
“vetted
researchersˮ
to
interrogate
through
Article
40.4
requests,
which
allow
researchers
meeting
certain
qualifications
to
apply
to
access
non-public
data
sets.
Access
to
public
data
via
Article
40.12
could
be
an
important
exploratory
mechanism
to
help
formulate
stronger
Article
40.4
requests.
29C o n c l u s i o n
This
research
has
sought
to
take
a
first
look
at
many
of
the
new
or
revised
public
data
sharing
mechanisms
provided
by
large
online
platforms,
in
the
context
of
the
Digital
Services
Act.
The
DSA
is
establishing
a
novel
structure
for
data
sharing
between
platforms
and
vetted
researchers
under
its
Article
40.
However,
it
also
establishes
a
requirement
for
public
data
sharing
Article
40.12.
In
this
research
we
consider
public
data
sharing
by
19
platforms.
We
developed
an
assessment
rubric
to
score
each
program
based
on
criteria
developed
in
consultation
with
partners.
In
our
47
criteria,
we
try
to
reflect
the
research
needs
of
the
wider
public
interest
research
community
who
currently
or
would
likely
make
use
of
this
public
data.
We
developed
these
criteria
in
the
absence
of
key
regulatory
concepts
like
a
definition
of
public
data.
Our
scores
c a n n o t
a n d
s h o u l d
n o t
be
interpreted
to
assess
compliance
under
the
Digital
Services
Act.
We
acknowledge
that
our
scores
also
represent
a
snapshot
or
moment
in
time
look
at
these
programs.
Indeed,
we
hope
this
report
will
nourish
the
continued
development
of
these
programs.
To
that
end,
we
provide
our
rubric
for
evaluating
these
programs
based
on
our
detailed
criteria
along
with
this
first
set
of
scores.
We
also
offer
25
specific
recommendations
to
regulators,
platforms,
and
researchers.
30Platform
Appendix
31D e t a i l e d
S c o r e s
B r e a k d o w n
For
a
complete
list
of
each
platform
and
their
respective
scores
on
each
measure,
we
have
produced
a
separate
document
that
can
be
accessed
here
to
review,
compare,
and
download
the
data
.
These
scores
are
accurate
as
of
May
1st,
2024
and
do
not
reﬂect
any
changes
by
the
platforms
since
that
date.
A l i E x p r e s s
O v e r v i e w :
AliExpress
has
established
the
Open
Research
and
Transparency
portal,
which
allows
approved
researchers
to
request
access
to
publicly
available
data.
AliExpress
offers
“privacy
protected
datasets
and
other
statistical
dataˮ
as
well
as
the
Dataworks
API
through
an
“internal
network-based
controlled
access
environment
that
does
not
allow
data
to
be
exported.ˮ
Researchers
affiliated
with
academic
institutions
and
nonprofit
organizations
in
the
EU
can
apply
for
access.
W h a t
w e
l o o k e d
a t :
●
Researcher
access
overview
site
●
Application
form
R e s o u r c e
L i n k s :
●
EU
Digital
Services
Act
●
Open
Research
&
Transparency
●
AliExpress
Open
Research
&
Transparency:
Application
for
access
to
publicly
accessible
information
by
researchers
O u t r e a c h :
●
We
reached
out
to
AliExpress
for
comment
and
discussion,
but
did
not
receive
a
response.
32A m a z o 


key: chroma:document
string_value:
v i e w :
AliExpress
has
established
the
Open
Research
and
Transparency
portal,
which
allows
approved
researchers
to
request
access
to
publicly
available
data.
AliExpress
offers
“privacy
protected
datasets
and
other
statistical
dataˮ
as
well
as
the
Dataworks
API
through
an
“internal
network-based
controlled
access
environment
that
does
not
allow
data
to
be
exported.ˮ
Researchers
affiliated
with
academic
institutions
and
nonprofit
organizations
in
the
EU
can
apply
for
access.
W h a t
w e
l o o k e d
a t :
●
Researcher
access
overview
site
●
Application
form
R e s o u r c e
L i n k s :
●
EU
Digital
Services
Act
●
Open
Research
&
Transparency
●
AliExpress
Open
Research
&
Transparency:
Application
for
access
to
publicly
accessible
information
by
researchers
O u t r e a c h :
●
We
reached
out
to
AliExpress
for
comment
and
discussion,
but
did
not
receive
a
response.
32A m a z o n
S t o r e
O v e r v i e w :
Amazon
Store
does
not
offer
a
formal
program
for
data
access
at
this
time.
However,
a
spokesperson
for
Amazon
Store
responded
to
our
inquiry
via
email,
“We
can
confirm
that
our
Conditions
of
Use
do
not
prevent
researchers
who
comply
with
the
conditions
of
the
DSA
from
using
industry-standard,
research-specific
tools
to
collect
publicly
available
data
from
our
EU
Store,
for
the
purposes
of
Article
4012
of
the
DSA.ˮ
The
feasibility
of
collecting
data
in
this
way
remains
ambiguous
because
of
the
potential
for
anti-scraping
systems
to
inhibit
this
activity
in
the
real-world.
W h a t
w e
l o o k e d
a t :
●
Website
terms
and
conditions
R e s o u r c e
L i n k s :
●
Conditions
of
Use
&
Sale
O u t r e a c h :
●
Amazon
EU
responded
to
our
request
for
comment
and
discussion,
stating
that
the
EU
store
Conditions
of
Use
permit
DSA-eligible
researchers
to
use
“industry-standard,
research.-specific
toolsˮ
for
public
data
collection.
33A p p l e ʼ s
A p p
S t o r e
O v e r v i e w :
Appleʼs
App
Store
does
not
offer
a
formal
program
for
data
access
at
this
time.
When
reached
for
comment,
a
member
of
Appleʼs
DSA
Compliance
team
stated
the
company
has
“procedures
in
place
for
researchers
to
request
App
Store
data
that
is
publicly
available,
in
accordance
with
Article
4012
of
the
DSAˮ
and
that
researchers
“interested
in
obtaining
publicly
accessible
data
may
contact
Apple
DSA
Compliance.ˮ
W h a t
w e
l o o k e d
a t :
●
Digital
Services
Act
compliance
page
R e s o u r c e s :
●
European
Digital
Services
Act
DSA
O u t r e a c h :
●
We
reached
out
to
Apple
for
comment
and
discussion.
We
received
a
response
from
Apple,
which
detailed
the
above.
34B i n g
O v e r v i e w :
Bing
has
established
the
Qualified
Researcher
Program
to
offer
researchers
access
to
public
data.
Researchers
free
from
commercial
interests
can
apply
from
anywhere
in
the
world.
The
program
makes
available
the
Bing
Search
API,
Bing
Webmaster
Tools,
and
datasets
to
approved
researchers.
W h a t
w e
l o o k e d
a t :
●
Digital
Services
Act
compliance
page
●
Researcher
access
overview
site
●
Application
form
●
Tool
documentation
R e s o u r c e s :
●
EU
Digital
Services
Act
information
●
Bing
Qualified
Researcher
Program
●
Bing
Qualified
Researcher
Program
Application
●
Bing
Research
Resources
●
Bing
Web
Search
API
●
Bing
Webmaster
Tools
O u t r e a c h :
●
We
reached
out
to
Bing
for
comment
and
discussion.
We
applied
for
and
received
access
to
Bingʼs
program.
35B o o k i n g . c o m
O v e r v i e w :
DSA-eligible
researchers
can
apply
for
access
to
public
data
via
Booking.comʼs
Researchers
Data
Request
Portal,
though
it
is
not
clear
in
what
format
the
data
will
be
provided.
In
addition,
the
customer
terms
of
service
Section
A14.
Intellectual
Property
Rights)
for
Booking.com
state,
“Youʼre
not
allowed
to
monitor,
copy,
scrape/crawl,
download,
reproduce,
or
otherwise
use
anything
on
our
Platform
for
any
commercial
purpose
without
written
permission
of
Booking.com
or
its
licensors.ˮ
Given
that
the
access
granted
to
public
data
under
Article
40.12
of
the
Digital
Services
Act
requires
researchers
to
be
“independent
from
commercial
interests,ˮ
it
appears
that
DSA-eligible
researchers
are
likely
permitted
to
scrape
the
platform.
W h a t
w e
l o o k e d
a t :
●
Website
terms
and
conditions
●
Digital
Services
Act
compliance
page
R e s o u r c e
l i n k s :
●
Digital
Services
Act
●
DSA
Researchers
Data
Request
Portal
●
Booking.com
Researcher
Data
Use
Policy
●
Customer
terms
of
service
O u t r e a c h :
●
We
reached
out
to
Booking.com
for
comment
and
discussion,
but
did
not
receive
a
response
in
time
to
incorporate
into
our
report.
We
received
an
automated
response
with
an
application
to
determine
eligibility
for
data
access.
36M e t a :
F a c e b o o k
&
I n s t a g r a m
O v e r v i e w :
Meta
has
established
the
Meta
Content
Library
and
Content
Library
API
–
a
new
formal
program
offering
researchers
access
to
public
data
on
Facebook
and
Instagram.
The
MCL
offers
a
dashboard
interface
for
users
to
query,
sort,
and
filter
content.
The
Content
Library
API
enables
researchers
to
query
public
data
programmatically
and
analyze
it
in
a
clean
room.
The
application
process
and
MCL
access
are
managed
by
the
Inter-university
Consortium
for
Political
and
Social
Research
ICPSR
at
the
University
of
Michigan.
Researchers
can
apply
from
outside
of
the
EU.
Metaʼs
existing
program,
CrowdTangle,
is
set
to
be
discontinued
in
August
2024.
W h a t
w e
l o o k e d
a t :
●
Researcher
access
overview
site
●
Application
form
and
resources
●
Tool
documentation
●
Terms
and
conditions
R e s o u r c e
l i n k s :
●
Research
tools:
Meta
Content
Library
and
API
●
Meta
for
Developers:
Meta
Content
Library
and
API
●
SOMAR
InfoReady
Application
Guide
●
Other
research
tools
and
datasets
●
Product
Terms
for
Meta
Research
Tools
●
Frequently
asked
questions
O u t r e a c h :
●
We
reached
out
to
Meta
for
comment
and
discussion,
and
met
with
members
of
the
research
partnerships
and
policy
teams.
37G o o g l e
M a p s
O v e r v i e w :
Alphabet
has
established
a
formal
program
and
application
process
for
accessing
public
data.
To
access
Maps
data,
Alphabet
offers
“access
to
public
data
through
a
cloud-based
solution.ˮ
Only
researchers
in
the
EU
are
eligible
for
access
to
the
Google
Researcher
Program.
W h a t
w e
l o o 


key: chroma:document
string_value:
o u r c e
l i n k s :
●
Research
tools:
Meta
Content
Library
and
API
●
Meta
for
Developers:
Meta
Content
Library
and
API
●
SOMAR
InfoReady
Application
Guide
●
Other
research
tools
and
datasets
●
Product
Terms
for
Meta
Research
Tools
●
Frequently
asked
questions
O u t r e a c h :
●
We
reached
out
to
Meta
for
comment
and
discussion,
and
met
with
members
of
the
research
partnerships
and
policy
teams.
37G o o g l e
M a p s
O v e r v i e w :
Alphabet
has
established
a
formal
program
and
application
process
for
accessing
public
data.
To
access
Maps
data,
Alphabet
offers
“access
to
public
data
through
a
cloud-based
solution.ˮ
Only
researchers
in
the
EU
are
eligible
for
access
to
the
Google
Researcher
Program.
W h a t
w e
l o o k e d
a t :
●
Researcher
access
overview
site
●
Application
form
●
Tool
documentation
R e s o u r c e
l i n k s :
●
Google
Researcher
Program
●
Google
Researcher
Program
Application
●
Google
Transparency
Center:
Researcher
Engagement
●
Google
Researcher
Program
Acceptable
Use
Policy
●
Google
Maps
for
developers
O u t r e a c h :
●
We
reached
out
to
contacts
at
Alphabet
for
comment
and
discussion,
but
ultimately
only
met
with
a
representative
from
YouTubeʼs
policy
team.
38G o o g l e
P l a y
O v e r v i e w :
Alphabet
has
established
a
formal
program
and
application
process
for
accessing
public
data.
To
access
Play
data,
Alphabet
offers
“permission
for
limited
scraping.ˮ
Only
researchers
in
the
EU
are
eligible
for
access
to
the
Google
Researcher
Program.
W h a t
w e
l o o k e d
a t :
●
Researcher
access
overview
site
●
Application
form
R e s o u r c e
l i n k s :
●
Google
Researcher
Program
●
Google
Researcher
Program
Application
●
Google
Transparency
Center:
Researcher
Engagement
●
Google
Researcher
Program
Acceptable
Use
Policy
O u t r e a c h :
●
We
reached
out
to
contacts
at
Alphabet
for
comment
and
discussion,
but
ultimately
only
met
with
a
representative
from
YouTubeʼs
policy
team.
39G o o g l e
S e a r c h
O v e r v i e w :
Alphabet
has
established
a
formal
program
and
application
process
for
accessing
public
data.
To
access
Search
data,
Alphabet
offers
an
“API
for
limited
scraping
with
a
budget
for
quota.ˮ
Only
researchers
in
the
EU
are
eligible
for
access
to
the
Google
Researcher
Program.
W h a t
w e
l o o k e d
a t :
●
Researcher
access
overview
site
●
Application
form
R e s o u r c e
l i n k s :
●
Google
Researcher
Program
●
Google
Researcher
Program
Application
●
Google
Transparency
Center:
Researcher
Engagement
●
Google
Researcher
Program
Acceptable
Use
Policy
O u t r e a c h :
●
We
reached
out
to
contacts
at
Alphabet
for
comment
and
discussion,
but
ultimately
only
met
with
a
representative
from
YouTubeʼs
policy
team.
40G o o g l e
S h o p p i n g
O v e r v i e w :
Alphabet
has
established
a
formal
program
and
application
process
for
accessing
public
data.
To
access
Shopping
data,
Alphabet
offers
a
“permission
for
limited
scraping.ˮ
Only
researchers
in
the
EU
are
eligible
for
access
to
the
Google
Researcher
Program.
W h a t
w e
l o o k e d
a t :
●
Researcher
access
overview
site
●
Application
form
R e s o u r c e
l i n k s :
●
Google
Researcher
Program
●
Google
Researcher
Program
Application
●
Google
Transparency
Center:
Researcher
Engagement
●
Google
Researcher
Program
Acceptable
Use
Policy
O u t r e a c h :
●
We
reached
out
to
contacts
at
Alphabet
for
comment
and
discussion,
but
ultimately
only
met
with
a
representative
from
YouTubeʼs
policy
team.
41L i n k e d I n
O v e r v i e w :
LinkedIn
has
established
a
Researcher
Access
Program
and
application
process
for
accessing
public
data.
Global
researchers
can
apply
for
access
to
the
platformʼs
public
data,
but
the
format
the
data
is
provided
in
is
unclear.
W h a t
w e
l o o k e d
a t :
●
Researcher
access
overview
site
●
Application
form
●
Terms
and
conditions
R e s o u r c e
L i n k s :
●
LinkedIn:
Researcher
access
●
LinkedIn
Researcher
Access
Program
Application
●
Additional
Terms
for
the
LinkedIn
Research
Tools
Program
O u t r e a c h :
●
We
reached
out
to
LinkedIn
for
comment
and
discussion
and
received
a
response
from
a
member
of
the
platformʼs
legal
team.
We
requested
access
to
LinkedInʼs
program,
but
were
denied.
42P i n t e r e s t
O v e r v i e w :
Pinterest
has
established
an
application
form
through
which
global
researchers
can
request
access
to
the
platformʼs
public
data.
It
is
not
clear
what
format
the
data
is
provided
in.
W h a t
w e
l o o k e d
a t :
●
Digital
Services
Act
compliance
page
●
Application
form
R e s o u r c e
l i n k s :
●
Digital
Services
Act
●
Researchers
intake
form
O u t r 


key: chroma:document
string_value:
t e r e s t
O v e r v i e w :
Pinterest
has
established
an
application
form
through
which
global
researchers
can
request
access
to
the
platformʼs
public
data.
It
is
not
clear
what
format
the
data
is
provided
in.
W h a t
w e
l o o k e d
a t :
●
Digital
Services
Act
compliance
page
●
Application
form
R e s o u r c e
l i n k s :
●
Digital
Services
Act
●
Researchers
intake
form
O u t r e a c h :
●
We
reached
out
to
Pinterest
for
comment
and
discussion.
We
met
with
a
member
of
the
platformʼs
legal
team,
who
confirmed
researchers
can
request
approval
to
automatically
collect
publicly
accessible
data.
43S n a p c h a t
O v e r v i e w :
Snapchat
has
established
guidelines
and
an
email
contact
through
which
global
researchers
can
request
access
to
the
platformʼs
public
data.
According
to
Snapchat,
data
will
be
provided
to
the
researcher
in
a
.csv
file.
W h a t
w e
l o o k e d
a t :
●
Digital
Services
Act
compliance
page
●
Researcher
access
overview
site
R e s o u r c e
l i n k s :
●
Privacy
and
Security:
European
Digital
Services
Act
DSA
●
Researcher
and
Data
Access
Instructions
O u t r e a c h :
●
We
reached
out
to
Snapchat
for
comment
and
discussion
and
met
with
members
of
the
platformʼs
legal
and
regulatory
teams.
44T i k T o k
O v e r v i e w :
TikTok
offers
a
Research
API
that
allows
access
to
publicly
available
data
related
to
accounts
and
content
on
the
platform.
U.S.
and
E.U.
researchers
affiliated
with
non-profit
academic
and
research
institutions
are
eligible
to
apply.
W h a t
w e
l o o k e d
a t :
●
Researcher
access
overview
site
●
Application
form
●
Tool
documentation
R e s o u r c e
l i n k s :
●
Expanding
TikTok's
Research
API
and
Commercial
Content
Library
●
Research
API
●
About
Research
API
●
Research
API
Getting
Started
●
Research
API
FAQ
●
Research
API
codebook
●
Research
API
Terms
O u t r e a c h :
●
We
reached
out
to
TikTok
for
comment
and
discussion,
but
did
not
receive
a
response.
45W i k i p e d i a
O v e r v i e w :
The
Wikimedia
Foundation
has
made
its
public
data
available
in
a
variety
of
ways,
since
before
the
enactment
of
the
DSA.
Researchers
do
not
need
to
request
or
apply
for
access
to
the
data;
researchers
can
use
existing
tools
to
programmatically
collect
and
analyze
the
data.
W h a t
w e
l o o k e d
a t :
●
Tool
documentation
●
Researcher
access
overview
site
●
Terms
and
conditions
R e s o u r c e
l i n k s :
●
Wikipedia
is
now
a
Very
Large
Online
Platform
VLOP
under
new
European
Union
rules:
Hereʼs
what
that
means
for
Wikimedians
and
readers
●
Wikipedia
API
Parsed
Infobox.
Introducing
Structured
Contents
●
Research:Data
●
Wikimedia
Research
●
Wikimedia
Foundation
Open
Access
Policy
●
Wikipedia
Page
History
●
Terms:
Content
Licensing
●
Wikimedia
Downloads
●
Research
Data
FAQs
O u t r e a c h :
●
We
reached
out
to
Wikipedia
for
comment
and
discussion
and
met
with
members
of
their
legal
and
global
advocacy
teams.
46X / T w i t t e r
O v e r v i e w :
X
has
an
application
for
DSA-eligible
researchers
through
which
they
can
request
access
to
public
data
via
the
X
API.
This
pre-existing
API
is
available
to
other
researchers
for
a
fee.
W h a t
w e
l o o k e d
a t :
●
Researcher
access
overview
site
●
Application
form
●
Terms
and
conditions
●
Digital
Services
Act
compliance
page
●
Tool
documentation
R e s o u r c e
l i n k s :
●
Country-specific
Resources:
European
Union
●
Developer
Terms
of
Service
●
X
Developer
Platform:
Academic
research
●
X
DSA
Researcher
Application
●
Dev
community:
academics
●
Difference
between
commercial
and
noncommercial
usage
O u t r e a c h :
●
We
reached
out
to
X
for
comment
and
discussion,
but
did
not
receive
a
response.
47Y o u T u b e
O v e r v i e w :
YouTube
has
established
a
Researcher
Program
to
grant
academic
researchers
access
to
public
data
on
the
platform.
The
program
gives
access
to
YouTubeʼs
Data
API
after
approval
of
the
researcherʼs
application.
A
program
also
allows
access
for
limited
scraping
for
DSA-eligible
researchers.
W h a t
w e
l o o k e d
a t :
●
Researcher
access
overview
site
●
Application
form
●
Terms
and
conditions
●
Tool
documentation
R e s o u r c e
l i n k s :
●
YouTube
Program
Policies
●
YouTube
Researcher
Program
Application
●
YouTube
Program
Terms
and
Conditions
●
YouTube
Data
API
Overview
●
YouTube
API
Services
-
Developer
Policies
●
YouTube
API
Services
Terms
of
Service
O u t r e a c h :
●
We
reached
out
to
contacts
at
Alphabet
for
comment
and
discussion
and
met
with
a
representative
from
YouTubeʼs
policy
team.
48Z a l a n d o
O v e r v i e w :
Zalando
states
that
researchers
can
contact
the
platform
through
the
DSA
Single
Point
of
Contact
to
receive
data
“in
accordance
with
Article
40
DSA.ˮ
W h a t
w e
l o o k e d
a t :
●
Terms
and
conditions
R e 


key: chroma:document
string_value:
e
l i n k s :
●
YouTube
Program
Policies
●
YouTube
Researcher
Program
Application
●
YouTube
Program
Terms
and
Conditions
●
YouTube
Data
API
Overview
●
YouTube
API
Services
-
Developer
Policies
●
YouTube
API
Services
Terms
of
Service
O u t r e a c h :
●
We
reached
out
to
contacts
at
Alphabet
for
comment
and
discussion
and
met
with
a
representative
from
YouTubeʼs
policy
team.
48Z a l a n d o
O v e r v i e w :
Zalando
states
that
researchers
can
contact
the
platform
through
the
DSA
Single
Point
of
Contact
to
receive
data
“in
accordance
with
Article
40
DSA.ˮ
W h a t
w e
l o o k e d
a t :
●
Terms
and
conditions
R e s o u r c e
l i n k s :
●
Zalando
and
the
Digital
Services
Act
●
Zalando
files
legal
action
against
the
European
Commission
to
contest
its
designation
as
a
“Very
Large
Online
Platformˮ
as
defined
by
the
Digital
Services
Act
●
Legal
Notice
O u t r e a c h :
●
We
reached
out
to
Zalando
for
comment
and
discussion,
but
did
not
receive
a
response.
49T h i s
r e p o r t
w a s
p r o d u c e d
b y :
Cameron
Hickey
Kaitlyn
Dowling
Isabella
Navia
Claire
Pershan
Design
by:
Shannon
Zepeda
and
Tess
Heinricks
W i t h
t h a n k s
t o :
Becca
Ricks
Nicholas
Piachaud
Julian
Jaursch
Martin
Degeling
Brandon
Silverman
Svea
Windwehr
Anna
Lenhart
Also
a
special
thanks
to
the
participants
of
Mozillaʼs
workshop
held
in
April
2023
and
everyone
who
contributed
to
and
endorsed
the
subsequent
recommendations
for
public
data
sharing
for
public
interest
research.
5051


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\Report-on-EDMO-Workshop-on-Platform-Data-Access-for-Researchers-2.pdf


key: chroma:document
string_value:
European Digital Media Observatory Report on EDMO Workshop on Platform Data Access for Researchers Lisa Ginsborg Contributors: Kalina Bontcheva Valentin Châtelet Philipp Darius Matt Motyl Andreas Neumeier September 2024 2 Report on EDMO Workshop on Platform Data Access for Researchers About the Workshop 3 Background: Data access provisions in EU regulation and self-regulation on disinformation 3 Workshop programme 4 Key Takeaways from the EDMO Workshop 4 Findings from surveying the EDMO Network on researcher data access 6 Access to data for researchers under DSA Art. 40(4), 40(12) and EDMO’s work on data access 7 Online Platform Data Collection and Access 8 Experiences challenges and opportunities with platform APIs 10 TikTok Research API 10 YouTube API, Google Search and other platform APIs 11 Meta Content Library and API 13 The European Digital Media Observatory has received funding from the European Union under contract number LC-01935415 3 About the Workshop On 15 May EDMO organised a workshop on the topic of Platform Data Access for Researchers, at the Brussels School of Governance. The workshop (led EUI STG in collaboration with Globsec) took place in hybrid format and was attended by over 50 participants in person and 25 online, including representatives from the EDMO Network, civil society organisations, as well as EC representatives and some VLOP representatives. The workshop aimed to bring together the research community to discuss and share their experience and views on platform data access for research, including newly developed platform APIs, the type of data available and its accessibility, and whether the new research data access provisions under the DSA meet the needs of the research community. Speakers from the research community (including representatives from the EDMO.eu and Vera.ai projects, the Integrity Institute, the Digital Forensic Research Lab, and the Center for Digital Governance, Hertie School) provided key insights 


key: chroma:document
string_value:
DSA meet the needs of the research community. Speakers from the research community (including representatives from the EDMO.eu and Vera.ai projects, the Integrity Institute, the Digital Forensic Research Lab, and the Center for Digital Governance, Hertie School) provided key insights and shared concrete experiences with regard to new and old data access tools provided by VLOP and VLOSEs as well as potential opportunities and challenges for research. Given the key role of independent research in enabling transparency and independent oversight and a deeper understanding of the disinformation phenomenon, especially in the context of new technological developments and upcoming elections worldwide, wider data access for research organisations conducting independent research in the public interest remains a key priority for the EDMO community. Background: Data access provisions in EU regulation and self-regulation on disinformation In the 2022 Strengthened Code of Practice on Online Disinformation many online platforms explicitly committed to provide access, wherever safe and practicable, to “continuous, real-time or near real-time, searchable stable access to non-personal data and anonymised, aggregated, or manifestly-made public data for research purposes on Disinformation through automated means such as APIs or other open and accessible technical solutions allowing the analysis of said data.” Such voluntary commitment has now become a legal obligation for VLOPs/VLOSEs under DSA article 40(12) which explicitly requires platforms to provide access to publicly accessible data, and when technically possible to real-time data. The Delegated Act on data access which was scheduled to be adopted in spring 2024 has not yet been released. Data access provisions for researchers present a rapidly changing area, with a number of new tools being developed by platforms especially through researcher specific APIs to allow access to researchers to real time data. Yet a number of limitations appear to be currently hindering their use by the research community, 


key: chroma:document
string_value:
with a number of new tools being developed by platforms especially through researcher specific APIs to allow access to researchers to real time data. Yet a number of limitations appear to be currently hindering their use by the research community, including lack of awareness of the new tools, limited access for civil society researchers, complicated or lengthy application procedures and potential legal risks deriving from their use. As a result, the uptake of APIs appears slow and piecemeal, with very few European researchers actively 4 using such APIs at present. Although greater uptake may be expected as the tools continue to be rolled out and refined, as most tools are still being tested it is essential to better understand their utility and how they compare to previous instruments. Workshop programme Moderator: Claes de Vreese | EDMO Executive Board, University of Amsterdam Framing the issues surrounding data access for research Speakers: • Lisa Ginsborg | EDMO, School of Transnational Governance, EUI • Rebekah Tromble | George Washington University, EDMO • Matt Motyl | Integrity Institute Exchange of experience using current platform APIs Speakers: • Kalina Bontcheva | University of Sheffield, BROD, vera.ai • Valentin Châtelet | DFRLab, Atlantic Council • Philipp Darius | Center for Digital Governance, Hertie School • Andreas Neumeier | Bundeswehr University Key Takeaways from the EDMO Workshop Despite the DSA having entered into force, and its key provisions with regard to data access for research purposes as contained in Art. 40, in practice data access for researchers has not yet seen a significant overall improvement to date. In fact, in certain areas or in relation to specific tools data access for researchers appears to present significant limitations and in certain cases may have even deteriorated over the last year. While this may be temporary as the new 


key: chroma:document
string_value:
In fact, in certain areas or in relation to specific tools data access for researchers appears to present significant limitations and in certain cases may have even deteriorated over the last year. While this may be temporary as the new instruments become operational, and before the delegated act on data access is adopted, a number of positive developments may also be noted in this area. These include public statements by the EC that the interpretation of Art. 40(12) appears to enable non-permissioned scraping,1 and the fact that researcher data access provisions under Art. 40(12) now exist for the large majority of VLOPs at least on paper, although in many cases the details of the concrete programs and data available are still missing. In practice current data access for researchers by platforms remains limited to date, with some platform APIs performing better than others while a number of significant shortcomings remain and are presented in the current report. Among such limitations researchers report limited accessibility, complex application procedures which include significant risks with regard to liability and fines, and the requirement for applications to 1 See for instance Press Release of 12 July 2024 ‘Commission sends preliminary ﬁndings to X for breach of the Digital Services Act’, available at https://ec.europa.eu/commission/presscorner/detail/en/ip_24_3761 5 be linked to specific projects rather than approved at organizational level. The legal requirements for researchers imposed in the contracts by the platforms should therefore be clear and not prohibitive for smaller research organisations, in light of the risk of large fines and the lack of existing mechanisms to protect research organizations from such risks. Equality in terms of data access is also key: online platforms and search engines should be discouraged from providing data and/or funding to only a small group of researchers (on specific issues or from selected 


key: chroma:document
string_value:
research organizations from such risks. Equality in terms of data access is also key: online platforms and search engines should be discouraged from providing data and/or funding to only a small group of researchers (on specific issues or from selected countries), selected by the companies themselves in a non-transparent manner. Leaving aside the specific problems of each platform API, which are presented in detail in the current report, greater standardisation in data access API provisions by similar kinds of platforms and search engines is fundamental for researchers to be able to conduct cross-platform research, which is central to studying disinformation in a holistic way. In particular it is crucial for similar types of VLOPs and VLOSEs to provide similar types of data via their APIs in order to allow for comparability across platforms (e.g., TikTok and Instagram; Bing Search and Google Search). While researchers made it clear that platforms providing researchers with data through their APIs should be seen as a very welcome development as few researchers appear to be gaining access to some of the platform APIs at present, data quality and reliability also appears to be a concern among researchers when using these APIs. This underlines the need for an independent entity that could be testing and ensuring data quality under DSA Article 40(12), and potentially under Articles 40(4); 40(8), as it is clear that this cannot be done by individual researchers. With regard to the way data is accessed through specific APIs, streaming/real-time APIs (e.g., previous Twitter API) allowing to get continuously new sets of data may be preferable to APIs in which periodic downloading is required (YouTube and TikTok) as this may also limit the kind of research that is possible. Finally the clean room approach of the Meta Content Library and API is highly restrictive 


key: chroma:document
string_value:
be preferable to APIs in which periodic downloading is required (YouTube and TikTok) as this may also limit the kind of research that is possible. Finally the clean room approach of the Meta Content Library and API is highly restrictive with respect to repeatability and open science, also in light of the fact that the clean room is cleaned after a certain period of time and the requirement of access through VPN is also problematic for data transparency. Overall it is essential that while new tools are rolled out and tested, data access for researchers should improve urgently and continue to do so over time for all VLOPs and VLOSEs while ensuring the information provided to the research community is clear and user friendly. Imposing fees for data access for researchers does not allow for such incremental access. With regard to DSA Art. 40(4), the system will only become fully operational once the Delegated Act is released. The work done (and presented during the workshop) by the EDMO Working Group for the Creation of an Independent Intermediary Body to Support Research on Digital Platforms (led by Dr Rebekah Tromble), as well as the draft Code of Conduct on how platforms can share data with independent researchers while protecting users’ rights will play a key role going forward. Collaboration will be key for researchers to ensure research priorities are prominent and the processes and institutions, including relevant Digital Services Coordinators (DSCs) are not overwhelmed. In this respect, the importance of researchers being aware of the variety of data collected by platforms, which may be requested for research purposes, becomes even more pressing. Greater information sharing and relevant tools are essential in this respect, including the data dictionary currently being developed by the Integrity Institute, including keywords, phrases in metrics, and variables 


key: chroma:document
string_value:
which may be requested for research purposes, becomes even more pressing. Greater information sharing and relevant tools are essential in this respect, including the data dictionary currently being developed by the Integrity Institute, including keywords, phrases in metrics, and variables researchers might request for research purposes. 6 Findings from surveying the EDMO Network on researcher data access Lisa Ginsborg presented the results from a recent survey conducted by EDMO.eu, inter alia, with research representatives in the EDMO Hubs surrounding VLOPSEs implementation of their commitments on the empowerment of researchers under the Strengthened Code of Practice (CoP). The report from the survey describes a number of limitations faced by the research community with regard to access to platform data as a pre-condition for transparency and accountability that is long overdue. In particular the Research Survey conducted by EDMO shows that data transparency and data access through APIs (Commitment 26) continues to be a key priority for the research community. Despite encouraging reports by all platforms on recent launches of new tools for researchers, the uptake of APIs appears slow and piecemeal, with very few European researchers among EDMO Hubs seemingly using such APIs at present. Several reasons may be ascribed to the lack of use of new APIs by EDMO Hubs, starting most obviously from their recent set up. Other reasons which emerged from asking researchers in EDMO hubs include lack of awareness of the new tools, complicated or lengthy application procedures and potential legal risks deriving from their use. While greater uptake may be expected as the tools continue to be rolled out and refined it is clear that simply launching an API for researchers may not be enough to meet the requirements of Commitment 26 and ultimately the DSA. Given most tools are still being tested, it remains difficult 


key: chroma:document
string_value:
be rolled out and refined it is clear that simply launching an API for researchers may not be enough to meet the requirements of Commitment 26 and ultimately the DSA. Given most tools are still being tested, it remains difficult to understand their utility and how they compare to previous instruments. The training sessions, workshops, and collaboration environment for fact-checkers and researchers offered by CrowdTangle in the past (which allowed researchers to exchange experience, tools and methodology and provided a clear point of contact for researchers) constitute good practices in this regard. Researchers reported them to be especially useful around election periods. A number of problems were also reported by EDMO Hubs, including: length of the application process by platforms, making it difficult for researchers to realise the intended research projects within the funding period; the challenges of reconciling the contractual requirements with the conditions of independent research and the protection of employees by the university; as well as complicated authorisation procedures and concerns in respect of the current conditions imposed in contracts by the platforms, including the risk of large fines for research organizations and the lack of existing mechanisms to protect research organizations from such risks. A number of concrete recommendations also emerged from EDMO Hubs representatives from the survey including: • The need for platform tools and interfaces for data access to be rolled out fast; • The need to raise awareness about the newly developed APIs, including making the information clear and user friendly and providing training and support to the research community on these tools; 7 • The need for application procedures to be clear and for applications by researchers to be approved swiftly; • The suggestion for applications to be approved at organizational level, as opposed to being linked to specific projects; • The 


key: chroma:document
string_value:
7 • The need for application procedures to be clear and for applications by researchers to be approved swiftly; • The suggestion for applications to be approved at organizational level, as opposed to being linked to specific projects; • The data provided should meet the needs of the research community by enabling incremental and near real-time access to data, which should also include providing researchers with information on data that is flagged as misinformative; • Allowing access to the APIs also for researchers from civil society; • Providing support to researchers entering legal contracts, e.g., establishment of a legal protection/insurance system for public research institutions, NGOs and independent researchers; • Greater standardization of APIs will allow the research community to use them more widely, rather than having to gain specific skills for each platform; • Going forward the question may be raised of whether specific tools could be developed which could enable the use of APIs by researchers from different disciplinary backgrounds beyond data scientists Access to data for researchers under DSA Art. 40(4), 40(12) and EDMO’s work on data access Rebekah Tromble provided a number of updates and insights on the state of state of data access under the DSA, in particular with regard to article 40(12) and article 40(4) and what may be expected going forward as well as EDMO’s work on data access in preparation for Art. 40(4) becoming fully operational. While some elements are still missing including relevant delegated acts and guidance from DCSs, there are a number of actions researchers may already start working on now. Dr. Tromble started by emphasising some of the positive developments in light of DSA Art. 40(12), including the public statement from a number of key members of the EC that their interpretation of Art. 40(12) is that it enables 


key: chroma:document
string_value:
now. Dr. Tromble started by emphasising some of the positive developments in light of DSA Art. 40(12), including the public statement from a number of key members of the EC that their interpretation of Art. 40(12) is that it enables non-permissioned scraping. Programs exist with regard to data access under Art. 40(12) for the large majority of VLOPSEs at least on paper, although in many cases the details of the concrete programs and data are still missing. Both the platforms and the researchers need more guidance from the EC about the requirements for such programs, but this is unlikely to come before the Delegated Act for Art. 40(4) is released, given the need for harmonisation between the different provisions. EC interest in this area is demonstrated by its inquiries to all of the VLOPs and VLOSEs for more information about their Art. 40(12) programs, as well as by the formal investigations into X and Meta, including for their compliance with Art. 40(12). Other organizations are also stepping in, including EDMO, the Institute for Data, Democracy & Politics with its Tracker aiming to describe existing research access tools, the Coalition for Independent Technology Research with its DSA Data Access Audit and Survey, which aims to gather information about the experience of researchers with the data access programs and in the future aims to work with researchers to put together applications in order to test the systems directly. 8 With regard at Art. 40(4), researchers who are affiliated with research organizations as defined by the EU Copyright Directive will have the ability to apply for specific non-public data under Article 40(4). While the exact details of this still need to be clarified, it is clear that both civil society and academic organizations that have a substantial research mission will qualify under Article 


key: chroma:document
string_value:
to apply for specific non-public data under Article 40(4). While the exact details of this still need to be clarified, it is clear that both civil society and academic organizations that have a substantial research mission will qualify under Article 40(4). It remains to be clarified whether non-European research institutions will qualify, raising the importance of collaboration going forward. The data researchers can apply for must be ‘in scope’, applying to European systemic risks and potential mitigations for those risks. The request must be proportionate, the data must ‘exist’, must not jeopardise trade secrets, and must comply with GDPR. The EDMO Draft Code of Conduct aims to help researchers and regulators in this respect and is providing a partial blueprint for the delegated act, and aims to provide further guidance also to the DSCs. With regard to the application process, this will be further clarified in the Delegated Act, but is likely to see researchers submitting their applications to local DSCs, the DSC in most instances would send the application to an independent intermediary body to provide an advisory opinion, which the EDMO Working Group for the Creation of an Independent Intermediary Body to Support Research on Digital Platforms has been working on. The local DSC would then send the recommendation to the DSC of establishment (in most cases the Irish DSC), which would make the final decision. If positive, designated researchers would be involved as “vetted researchers” and make “reasoned request” for the data of platform(s). Platforms will then have 15 days to respond, and may also object either because they don’t have the data or on trade secrets grounds. A negotiation process may be expected in this context involving the regulators, the platforms and the researchers themselves with the likely involvement of the intermediary body. Potential hurdles and 


key: chroma:document
string_value:
because they don’t have the data or on trade secrets grounds. A negotiation process may be expected in this context involving the regulators, the platforms and the researchers themselves with the likely involvement of the intermediary body. Potential hurdles and unknowns remain, including in relation to how to tailor the GDPR risk assessment in relation to the data received, assessing who qualifies and what qualifies for research projects, what might the platform fees be if any, but the biggest potential hurdle is overwhelming the regulators with data requests. It is therefore important for researchers to provide feedback to the regulators but most importantly cooperate with one another to not overwhelm the system. Once the intermediary body is established, it aims to bring researchers together for consultations in Fall 2024 to identify the most pressing data needs and priorities to be shared with DSCs. Online Platform Data Collection and Access Matt Motyl from the Integrity Institute aimed to support researchers outside of industry to learn about what data is currently collected by the relevant companies. This includes the obvious data provided by users, the less obvious data extracted by platforms, and additional data that is learned about users often through machine learning, AI or by buying data from third parties. While the presentation started from Facebook, the lessons were seen to be applicable to most social media platforms. Dr. Motyl, presented some of the categories of data users normally provide to Facebook, either directly or through their consumption patterns or posts and additional data platforms may extract from the data provided by users. Further user behaviours on the 9 platforms (e.g. time spent on platforms, clicks including on ads, purchases, reactions, comments, reporting behaviour, etc.) provide signals to platforms on content to be fed to users. Time spent engaging in such 


key: chroma:document
string_value:
by users. Further user behaviours on the 9 platforms (e.g. time spent on platforms, clicks including on ads, purchases, reactions, comments, reporting behaviour, etc.) provide signals to platforms on content to be fed to users. Time spent engaging in such behaviours is also logged. Further data is provided on how users interact with each other including in relation to all of the behaviours above. Less obvious data that platforms extract about users includes device metadata, from which they can extract where people are located, what network they are on, whether they use multiple devices, whether multiple people use the same devices for access to those platforms, GPS location, and all kinds of network information, including phone numbers and names, whether they are also on that platform, and from there establish networks, which can help establish by way of example what people in specific networks may buy, or even instances of coordinated inauthentic behaviour. More sophisticated information that may be collected includes the probability users are real and are who they say they are, probability users will buy specific things, who users are likely to vote for, what parties they may belong to or how likely they are to show up to a political event, whether the user is working in coordination to interfere with another country’s election, whether the user produces unwanted social interactions. Most of the above information will exist at the user level but also at the level of content, group, ad, page, etc. Dr. Motyl also introduced the way data is stored by the platforms, in particular the two main types of categories for data storing: dimension tables and fact tables. Dimension tables are mostly structured, i.e., containing one row per aggregated object (e.g., user, post, page, post, video) with a key id and one column per 


key: chroma:document
string_value:
the two main types of categories for data storing: dimension tables and fact tables. Dimension tables are mostly structured, i.e., containing one row per aggregated object (e.g., user, post, page, post, video) with a key id and one column per variable (and there may often be 1000s of variables). Fact tables, on the other hand, are mostly unstructured with often one row per event, which are not stored in columns but often in JSON strings, MAPs, Arrays (theoretically could be 0 to infinite length) with key-value pairs. For large platforms it is probably impossible to have a single table containing all variables, as it would probably involve many exabytes of data if not more. Different categories of variables can be stored in different tables and even different warehouses or cloud services. Joining data is therefore quite complicated. Further, while thousands of tables may exist per user, page, group, etc., these tables may also have different retention times, until the data is transferred to a different format and becomes much more difficult to obtain. Different platforms will also have different data retention policies and even within a company, different security / privacy settings may apply to different tables and even columns. In light of the above accessing specific data may become quite complicated or take a long time. Matt Motyl and the Integrity Institute are currently building a data dictionary, including keywords, phrases in metrics, variables researchers might want, how to map users activities to these data table, community requests, with the aim that researchers will know what to ask for when they are requesting platform data, in order to not overburden regulators going forward. 10 Experiences challenges and opportunities with platform APIs TikTok Research API Dr. Philipp Darius from the Center for Digital Governance at the Hertie School and Andreas 


key: chroma:document
string_value:
when they are requesting platform data, in order to not overburden regulators going forward. 10 Experiences challenges and opportunities with platform APIs TikTok Research API Dr. Philipp Darius from the Center for Digital Governance at the Hertie School and Andreas Neumeier from the Bundeswehr University in Munich presented their experiences, current requirements and problems in using the TikTok Research API. In a collaboration with the SPARTA project the team collected political party communication on Facebook, Instagram, TikTok, Twitter/X and YouTube during the EU elections. For accessing the TikTok Research API it took TikTok approximately 4 weeks to grant the application for the Research API. The TikTok Research API, it was made accessible to European researchers on July 20, 2023. The websites entailed contradicting information on whether the API is available only to European researchers or to researchers globally that focus on European systemic risks. The stated aim is to ‘support research and increase transparency’ and a collaboration team with up to 10 researchers in one lab on the developer platform may be formed, which should enable pooling of API keys to increase the quotas of API requests. TikTok has also initiated a commercial content library that includes ads, advertiser metadata and targeting information. In order to get access to the Researcher API an application form needs to be submitted, and the researchers must adhere to the Community Guidelines and the TikTok Research API Services Terms of Service. The research proposal needs to be approved by the research institution's ethics committee, there should be no conflict of interest and no commercial purposes and the researcher should have demonstrated experience and expertise and be employed by a not-for profit organization in the EU or in the US. With regard to the data that can be collected with the TikTok Research API, researchers 


key: chroma:document
string_value:
purposes and the researcher should have demonstrated experience and expertise and be employed by a not-for profit organization in the EU or in the US. With regard to the data that can be collected with the TikTok Research API, researchers can generally collect content on public accounts by “creators” or users with public profiles and who are aged 18 and over. Information may in theory be collected on videos, comments, users, liked/reposted/pinned videos, follower and following lists (if following list is made public). Dr. Darius went on to describe their experience of using the TikTok API in practice while working on a cross-platform study collecting communication on TikTok, YouTube, Instagram, Facebook, and X by all European political parties participating in the 2024 EU elections. Especially for the TikTok side of the collection they have been facing serious issues regarding the data retrieved via the TikTok Research API. In particular, the data provided between March and June 2024 cannot be used for research on party campaign communication behaviour as it deviates strongly from metrics shown in the app or on the webpage as TikTok user interfaces. Mr. Neumeier proceeded to provide concrete examples of the problem experienced, in which comparing the JSON retrieved from the API to the relevant TikTok webpages a number of disparities could be noticed in particular with regard to the likes count, comments count (which in the API appears to include the favorites count), the share count, and the view count in which very significant differences 11 can be noted. Overall, the data provided by the API on some of the metrics was not reliable and cannot be used for their current research project. They faced the following issues: • The API drastically underreported view and share counts of videos in contrast to metrics visible on TikTok’s 


key: chroma:document
string_value:
on some of the metrics was not reliable and cannot be used for their current research project. They faced the following issues: • The API drastically underreported view and share counts of videos in contrast to metrics visible on TikTok’s user interfaces on the website and in the TikTok App. • Conflation of comment count and favourites count metric. • The follower collection was interrupted at around 3,000 accounts, and there appears to be some kind of limit on it but the reason for this remains unclear. • API data is not available in real-time, as obligated in DSA 40(12) but with an approximately 10-days delay. The researchers have reached out to the TikTok API support team, and after some time they have now received availability to schedule an appointment to discuss the problems with the data and potential underlying issues with the API. The team thereafter also reported the issues to the Bundesnetzagentur, as the German Digital Service Coordinator, and staff members of DG Connect. While biases of other research APIs (e.g. Twitter’s Streaming API (see Morstatter et al., 2013) are known, in the case of the TikTok API more than a bias, the data was faulty. In July 2024 the team found that the TikTok Research API seems to have been repaired and provides only marginally deviating metrics from the user interface (which is acceptable for distributed systems). However, the identified problems underline the need for an independent entity that could be testing and ensuring data quality under DSA Article 40(12), and potentially under Articles 40(4); 40(8), since individual researchers cannot test all the data provided by platforms via APIs or via data access requests. The data tracker by the Weizenbaum Institute was also mentioned as a good practice that could be combined with other data access trackers 


key: chroma:document
string_value:
individual researchers cannot test all the data provided by platforms via APIs or via data access requests. The data tracker by the Weizenbaum Institute was also mentioned as a good practice that could be combined with other data access trackers to bundle researchers’ experiences when working with platform data. YouTube API, Google Search and other platform APIs Kalina Bontcheva from the University of Sheffield provided an account and reflections on her experience with data access at the University of Sheffield and as part of the Vera.ai EU-funded project. In particular she presented her experience with the YouTube API as well as a number of other APIs. In terms of positives the YouTube API gives access to the video descriptions, the subtitle data (if present), channel descriptions, etc. Based on the video ID resarchers can retrieve all comments for that video, which is important when analysing responses to a specific video that is spreading disinformation. The video comments also tend to have accurate timestamps. However, a number of issues were also encountered with regard to the YouTube API, which could be improved over time as the dialogue on data access with platforms 12 progresses. When retrieving comments, all comments always appear, and there is no way of retrieving only new comments posted since a certain date, which would be more efficient with respect to the usage on the researcher API data quota. Similarly, to check for new replies to existing top-level comments researchers must query each top-level comment individually to get all of its children and then work out which ones are new. Researchers would benefit from an API call that gave all top-level and reply comments on a given video that are dated after a given timestamp. Further, the "search" API (to find videos matching search terms, or all videos 


key: chroma:document
string_value:
are new. Researchers would benefit from an API call that gave all top-level and reply comments on a given video that are dated after a given timestamp. Further, the "search" API (to find videos matching search terms, or all videos posted by a given channel) is extremely expensive in terms of quota. The daily quota is thereby exhausted after just a few searches, which put limits on the speed at which research may be conducted. While there is an explicit provision stating that “On request, and with sufficient justification, you will receive sufficient API quota for use as specified by this Program ToS”, it would be important to clarify the protocol for increasing the quota. The biggest problem, which may relate also to the TikTok API, is that when the data is downloaded it is a snapshot at the time it was downloaded. Differently from the previously available Twitter streaming API, it is therefore not a streaming/real-time API allowing to get continuously new sets of data, but periodic pulling is required and data may therefore be a bit out of date, which also limits the kind of research you can do. Prof. Bontcheva also presented her experience with other platform APIs, starting from the TikTok Research API, for which their application was successful and the researchers are getting rich data via their comprehensive research API and documentation, despite some of the issues with data quality discussed earlier. Bing provides access to thematic datasets for Search, which from the perspective of a scientist are very important as they allow open science and repeatability and it means that different researchers can compare results also with regard to their AI models. Bing also provides API access for news, web, image, and other search, which is very valuable. Finally from Google Search it is 


key: chroma:document
string_value:
and repeatability and it means that different researchers can compare results also with regard to their AI models. Bing also provides API access for news, web, image, and other search, which is very valuable. Finally from Google Search it is possible to get access to Google Trends, the Fact-check API and the Ad library, which have been available for some time. Google Search however does present a number of access limitations. In particular, researchers would benefit from access to free quotas to the Google Custom Search JSON API, which would seem easy to provide, as in the case of YouTube. Further, Google search thematic collections would also be extremely valuable for researchers comparable to those from Bing. This is important because disinformation does not live on one platform and researchers need to be able to answer cross-platform research questions, e.g., are citizens exposed to disinformation in their search results, irrespective of which search engine they use? What is the difference between search results provided by the different search engines that are signatories to the CoP? At present it is impossible to answer those types of questions, because different search engines are interpreting the idea of research data access in very different ways. Shared research collections across platforms are very important for open science and repeatability and provide insight into the history. Further, while APIs may of course differ across platforms it is important to have access to the same kinds of data in order to allow for comparability across platforms. The importance of cross-platform research capabilities makes it essential for similar types of VLOPs to ideally provide similar types of data via their APIs that allows researchers to carry out cross-platform research. By way of example the clean room approach of 13 Instagram is highly restrictive with respect to repeatability 


key: chroma:document
string_value:
similar types of VLOPs to ideally provide similar types of data via their APIs that allows researchers to carry out cross-platform research. By way of example the clean room approach of 13 Instagram is highly restrictive with respect to repeatability and open science, also in light of the fact that the data access provisions as of April 2024, meant that the clean room is cleaned after a certain period of time. Research experiments should be repeatable over time and the methodology should be documentable. At present a number of research questions that EU-funded research projects on disinformation aim to investigate (e.g., Comparative impact analysis of disinformation videos/images on popular video and image sharing platforms) cannot be answered because the data access provisions by Instagram and TikTok are very different. Further, with the Instagram clean room it is not currently straightforward to import other URLs, e.g. debunked disinformation from other platforms, making potential research highly limited. Prof. Bontcheva also highlighted that in certain European countries the majority of political campaigning continues to take place on X/Twitter. Governments use it as a platform to communicate with the electorate, but it is no longer possible for researchers to study it. In particular researchers in the UK have received numerous requests from policy makers, regulators, and government bodies for in-depth, large-scale quantitative research on the prominence and impact of disinformation in public political discourse, which can no longer be satisfied as the X/Twitter API is no longer available for free to UK researchers. Further, data access for researchers from associated countries who are part of Horizon Europe projects such as the UK is currently being restricted by X, which is currently flatly rejecting all UK applications claiming that DSA provisions do not extend to UK researchers, even when working on EU projects funded by 


key: chroma:document
string_value:
of Horizon Europe projects such as the UK is currently being restricted by X, which is currently flatly rejecting all UK applications claiming that DSA provisions do not extend to UK researchers, even when working on EU projects funded by the EU and looking into disinformation in the EU. Finally equality in terms of data access among researchers is essential, and online platforms and search engines should be discouraged from providing data and/or funding to only a small group of researchers (on specific issues or from selected countries), selected by the companies themselves in a non-transparent manner. The importance of collaboration among researchers was further emphasised as well as the need for a shared understanding among all stakeholders on data access and research and its essential role for society and democratic integrity. This should include positive engagement by policy makers and platforms, beyond current narrow concerns about reputational risk. Lastly, in terms of data access provisions, and their monitoring, there is a need for more prominent input from AI/CS experts on the technological and standardisation aspects of data access provisions and their adequacy, which can have huge implications for research. Meta Content Library and API Valentin Châtelet from the DFRLab introduced the current data access landscape for Meta. As is well known Meta is decommissioning CrowdTangle (CT) starting from 14 August 2024, which is widely used in the research community including the participants to the workshop. In relation to this, the EC has initiated an enquiry on the potential infringement to the DSA of Meta’s current data access policy and tools. While none of the participants to the workshop, including Mr. Châtelet, had access to the Meta Content Library and API, he shared insights on the experience of some of his colleagues at the DFRLab. Meta also provides access to 


key: chroma:document
string_value:
tools. While none of the participants to the workshop, including Mr. Châtelet, had access to the Meta Content Library and API, he shared insights on the experience of some of his colleagues at the DFRLab. Meta also provides access to researchers to certain datasets, in particular to take-downs and CIB related deplatforming. 14 The procedures to receive access to the Meta Content Library and API were reported by Mr. Châtelet to be very long. Applications are reviewed by the Inter-university Consortium for Political and Social Research (ICPSR) at the University of Michigan. This includes questions about the researcher’s experience of handling confidential data as well as large datasets, and optional documentation from an Ethics Committee or Institutional Review Board (IRB). The Content Library is a Graphic User Interface (GUI) to query content from Meta, while the API allows to query through code, either R or Python, to public accounts with more than 25,000 followers, including public Pages, public groups, public events, public profiles, and even comments according to Meta’s documentation. Once researchers gain access the Content Library interface appears like a search engine, which includes the following sections: • Influence operations datasets, including CIB and other deplatformed taken-down content that is downloadable as CSVs • Saved searches: textual search queries that researchers can save for later use and continued monitoring • Producer list: collection of pages that populate a collection • Downloads (history of CSV files that have been downloaded by researcher) The Datasets section resembles the collections of CIB datasets from CT, but in terms of labelling contains significantly less information regarding how the content has been edited (or removed) when compared to CT, and explanations about what are the grounds justifying the existence of the ‘dataset’ also do not appear to be available. On the positive side, the 


key: chroma:document
string_value:
less information regarding how the content has been edited (or removed) when compared to CT, and explanations about what are the grounds justifying the existence of the ‘dataset’ also do not appear to be available. On the positive side, the CSV files of the datasets (including Meta takedowns and CIB) may be downloaded, as well as trend graph, which show the evolution of the amount of posts found when users query the search engine of the Content Library. In terms of limitations the Meta Content Library does not allow access to cross-platform searches. Each query on the search engine will therefore only be able to search for that specific query on Facebook or on Instagram, not on both. In this respect the Content Library is different from the Meta Ad Library which gives the opportunity to search across both platforms. In terms of the search interface using the textual search, researchers will still have access to several filters which were available on CT. While the results of the search can be saved in the personal account, they cannot be downloaded as a CSV file and it appears to be a less potent search engine, with no cross-reference search with Facebook & Instagram. Another limitation of the Meta Content Library is that researchers have access to even less search operators. Since the workshop, the use of quotes to perform literal searches was implemented, however, the search engine still does not support Boolean operators. At the time of the workshop, the use of quotes to perform literal searches was not available. In addition, handles and URLs of contents cannot be used to perform searches, which presents a significant setback compared to CT. Finally, there appears to be less search and query results than the numbers indicated for each search. The same appears 


key: chroma:document
string_value:
addition, handles and URLs of contents cannot be used to perform searches, which presents a significant setback compared to CT. Finally, there appears to be less search and query results than the numbers indicated for each search. The same appears to be true for the Meta Ad Library, where the number of Ads indicated is expressed in ranges instead of giving researchers an exact figure. A final significant limitation is that to access the Meta Content Library requires the use of a VPN, casting potential doubt on the monitoring of researchers’ activity and data on the platform. 15 DFR Lab observes that the amount of public data that is available via Meta tools increasingly lacks cross-compatibility with existing Meta products. Regarding the Meta Content Library and API, the Unique ID provided when searching for a specific Facebook page is only created within the Meta Content API and cannot be used to search on Meta’s technologies, including Facebook or Instagram, or and don’t provide access to the assets’ page using the URL facebook[.]com/<UniqueID>. The community also expressed worry regarding the contractual terms for accessing Meta research tools from a legal perspective especially for research institutions with fewer resources. Civil society actors such as the media and journalists are not intended to be granted access to the Meta Content Library and API. In addition, there is a requirement regarding publications to notify Meta of any forthcoming publication, which also raises issues with concern to the independence of research.2 2 See https://transparency.meta.com/researchtools/product-terms-meta-research last accessed 23 July 2024 16 The European Digital Media Observatory has received funding from the European Union under contract number LC-01935415 www.edmo.eu


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\Research API _ TikTok for Developers.pdf


key: chroma:document
string_value:
Research ToolsTikTok supports independent research about our platform.Through our Research Tools, qualifying researchers in theU.S. and Europe can apply to study public data aboutTikTok content and accounts. We're working to provideincreased access to Research Tools in the future.What data is available?With the research tools, researchers can access public data on:AccountsThis includes user profiles, followers and followinglists, liked videos, pinned videos and reposted videos.ContentFor more information on the data returned via our Research Tools,check out the Codebook
Who can apply?Applicants must fulfill the following criteria to qualify foraccess:Be located in an eligible region and be affiliated with aneligible organization:Academic institutions in the US, EEA, UK orSwitzerland; orNot-for-profit and/or independent research institution,organization, association, or body in the EU. We arecurrently beta testing this service with selectresearchers in the US, UK, Switzerland, Norway, Icelandand Liechtenstein.Have demonstrable experience and expertise in theresearch area specified in the application and in theprocessing and analysis of dataBe independent from commercial interests and be ableto conduct research on a not-for-profit or non-commercial basis pursuant to a public-interest missionDisclose the funding of the researchProvide a clearly defined research proposal and show theaccess requested is needed for, and proportionate to,the purpose of that researchCommit to fulfilling data security and confidentialityrequirements (including taking steps to protect personaldata)Be able to provide evidence that the research wentthrough an ethical research reviewBe prepared to uphold the requirements set out in theTikTok Research Tools Terms of ServiceHow to get access to Research Tools?
01Create research accountAfter ensuring your eligibility,create a TikTok for Developersaccount using your professionalemail address (for example, theemail associated with youruniversity or researchorganization).
02Submit applicationComplete and submit theapplication form by providingdetails about you, yourorganization, and your research
03Wait for approvalYou can typically expect to hearback from us within 4 weeks ofsubmission. TikTok may takeadditional time when furtherinformation is requested.Once approved, read the Getting Started guide to learn more 


key: chroma:document
string_value:
theapplication form by providingdetails about you, yourorganization, and your research
03Wait for approvalYou can typically expect to hearback from us within 4 weeks ofsubmission. TikTok may takeadditional time when furtherinformation is requested.Once approved, read the Getting Started guide to learn more about how to access our Research Tools.Need to work with a team?Once your application is approved, you can add collaborators to your research topic for shared access to datasets. Note: Pleaseprovide information about your collaborators in your application form. If your collaborators are from a different organization, makesure to submit separate applications for each organization. To learn more, check out How to manage an organization.Applying as a Ph.D. candidate?You will need to submit an endorsement letter from a professor or dissertation advisor. You can download a sample letter here.Researching on behalf of a not-for-profit non academic org?TikTok makes public data available for non-academic not-for-profit orgs within confined parameters. If your application for access isapproved, we will provide you with information on using our Virtual Compute Environment, which is subject to strict securitycontrols.Once approved for access, you may login to our Virtual Compute Environment.How to access research dataOnce your application is approved, check out our Getting Started with Research Toolsguide for step-by-step instructions on how to access research data.View guideQuestions?Check out our FAQ to learn more about ResearchTools accessFAQExplore how our Virtual Compute EnvironmentworksLearn moreNeed additional help? Contact us via SupportSupport
ProductsShare KitLogin KitContent Posting APIResearch APIDisplay APIEmbed VideosData Portability APIGreen Screen KitCommercial Content APIOther platformsTikTok EmbedsTikTok for BusinessAdvertise on TikTokTikTok Creative CenterTikTok.comCompanyAbout TikTokNewsroomContactCareersByteDanceTransparency Center© 2024 TikTokTerms of ServicePrivacy PolicyResources & LegalProductsDocsSupportBlogGet started


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\Researchers intake form _ Pinterest Help.pdf


key: chroma:document
string_value:
OverviewLast updated: March 14, 2024If you’re a researcher, use this form to request access to publicly-available data onPinterest.Please fill in all relevant information, and a Pinterest team member will get back to you.Your informationFull legal name*Phone*Email*Information about yourorganizationPlease provide information about your organization, such as the purpose and missionIs this a not-for-profit organization, body, or association?*Name of the organization*Phone*Street address*City*Postal code*
Address where research will be conducted (if different to above)Street addressCityPostal codeRequest detailsData request*
Please share which data set you would like access to and why, including the type of data, the time range and any geographic scope relevant.Are you, your organization, and your research independent from commercial interests?*Funding*
Please disclose the sourcing of funding for the research you are conducting.
Will the data you are requesting be used solely for the purpose of performing researchthat contributes to the detection, identification and understanding of systemic risks inthe European Union (as defined in Article 34(1) of the Digital Services Act)?*Additional context*
Please provide any relevant information about why you are submitting a data request.Data Security, Confidentiality, and Privacy*
Describe the technical and organizational measures you have put in place to protect personal data and ensure data security and confidentiality. SubmitResearchers intake form
YesNo
Country*United States
CountryUnited States
YesNo
YesNoInclude additional context on your research topic and project, how access to the requested data is necessary andproportionate to your research, and how your research will contribute to the detection, identification andunderstanding of systemic risks in the European Union.
By submitting this form, you understand and agree that your application, if successful, will be subject to additionalTerms and Conditions to be shared by Pinterest with you. Quick linksPinterest statusPolicyBusiness CommunityAcademyCompanyAbout PinterestNewsroomCareersInvestorsMore from PinterestBusinessesCreatorsDevelopers© 2024 PinterestTerms of ServiceCopyright & TrademarkPrivacy PolicyCookies policyPersonalized adsFollow at PinterestEnglish (US)Help CenterLog in or Sign upPinterest homeGeneralBusiness


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\Snapchat Transparency Center _ Researcher Access.pdf


key: chroma:document
string_value:
Istruzioni per l'accesso ai dati dei ricercatoriSe sei un ricercatore con scopi non commerciali e desideri richiedere l'accesso ai dati pubblicamente disponibili di Snap inconformità con il Digital Services Act (DSA), puoi inviare la tua richiesta di ricerca a DSA-Researcher-Access[at]snapchat.comcon le seguenti informazioni:Il tuo nome e il nome dell'organizzazione di ricerca affiliataUna descrizione dettagliata dei dati a cui desideri accedere Una descrizione dettagliata dello scopo per il quale stai richiedendo i datiUna descrizione dettagliata delle attività di ricerca e della metodologia in programmaDettagli sulle fonti di finanziamento della ricerca condottaConferma che la tua ricerca è a scopo non commercialeDettagli sulla tempistica dei dati richiestiUna volta ricevuta, esamineremo la tua richiesta per verificarne l'ammissibilità e la conformità alle leggi e ti contatteremo.
TrasparenzaReport sulla trasparenzaInformazioniGlossarioReport precedentiUnione EuropeaGalleria annunciAustraliaCaliforniaIndiaRicercatoriPrivacy, Safety, and Policy HubPoliticaPrivacySicurezzaTrasparenzaNotizie


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\The Research API falls woefully short.pdf


key: chroma:document
string_value:
The Research API falls woefully shortOctober 16, 2023📅 2023 · # analysis · 🏷 research 🏷 API *By: Santiago Sordo Ruz, Martin Degeling and Kathy MeßmerTikTok’s reach is measured in the billions. According to different sources, in 2022 it had 1.7 billion users, 1billion daily views and 1.12 billion monthly active users. This is why we need a systematic way of accessingdata about the platform to conduct thorough research about it - may it be for exploring the platform’saffordances or conducting a full-blown audit.One way TikTok provides access to some of its data is the Research API. It makes getting some insights intothe platform’s inner workings possible, but it is far from satisfactory. Especially because the provided data isvery limited compared to which data is publicly available via scraping. So, let’s have a closer look at that.
Image: The number of variables available on TikTok through different means of data acccess.TikTok’s Research APITikTok offers an application programming interface (API) where vetted academic researchers can obtaininformation about the content published by TikTok’s users. An API is —in short— a way to request and obtaininformation from a system. TikTok’s Research API provides access to what is essentially a carefully curateddatabase of the videos the platform hosts.The API provides data and metadata about comments, users and videos. The number of variables available foreach of these categories is as follows:
These variables contain information about different aspects of the objects in question. For example, this iswhat is available in the case of comments:1. Create Time: This is the time when the comment was posted on a video.2. ID: This is the unique comment ID for a comment posted on a video.3. Like Count: The total number of likes for a comment under a video created by users by clicking the“Heart” icon.4. Parent Comment ID: This is 


key: chroma:document
string_value:
video.2. ID: This is the unique comment ID for a comment posted on a video.3. Like Count: The total number of likes for a comment under a video created by users by clicking the“Heart” icon.4. Parent Comment ID: This is the unique ID of the parent comment when the user responds to anotheruser’s comment. If the comment was directly entered for a video, this ID is the same as the Video ID.5. Text: This is the actual text of the comment entered on a video. To protect the privacy of users, otherinformation is removed.a. Video_ID: This is the video ID for which the comment was entered.The API’s obcial codebook provides a detailed description of all available variables. While these may shed lighton some research questions, especially related to the analysis of content posted on the platform, they areextremely limited in number and scope.Getting more useful data is hardSince civil society organisations like the SNV can’t use the Research API, we decided to explore the platform onour own. We have done this using what is known as content scraping, which is the automated collection ofdata from online sources. We have collected data from two of TikTok’s clients: the Android app and the webapp.Scraping data from the web is quite common and poses a relatively low technical barrier. However, scrapingdata from a smartphone app such as TikTok’s Android client is quite challenging; we speak from experience.At the same time, scraping TikTok content from the Android app has proven invaluable. Its smartphone appsare the most natural way to use the platform —providing data closer to what users actually encounter— andthe amount and variety of the information we have collected is incomparable to what is available throughthe Research API.The Research API falls woefully shortScraping TikTok directly from the source has allowed us to collect 


key: chroma:document
string_value:
closer to what users actually encounter— andthe amount and variety of the information we have collected is incomparable to what is available throughthe Research API.The Research API falls woefully shortScraping TikTok directly from the source has allowed us to collect information on various platform aspects.We have gained more and better perspectives on comments, users and videos, and also into obciallyundocumented features like the app’s automated search suggestions.To illustrate this, let’s have a look at the data and compare the number of variables on which we have collectedinformation through scraping with those offered by the Research API:
You can have a look at each source’s codebook by clicking on the links in the table; note the trove of insightsthat scraping affords. Note as well that our codebooks are —and will remain— works in progress.As you can see, the Research API falls woefully short. Furthermore, keep in mind that documenting scrapeddata constitutes a technical challenge, meaning these numbers are conservative estimates.Why this mattersAccording to the company, the Research API serves the following purpose:TikTok supports independent research about our platform. Through our Research API, academicresearchers from non-proht universities in the U.S. and Europe can apply to study public data aboutTikTok content and accounts.Put into perspective, what TikTok offers is such a weak attempt at supporting independent research that onehas to ask whether the company is simply claiming credit without doing the work. To make things worse, asmentioned above, access is so restricted that our very own researchers at Stiftung Neue Verantwortung do notqualify for the API. Put simply, if we want to be able to scrutinise a platform like TikTok and thus assess thepotential harms and impacts that its widespread usage entails, the Research API is grossly inadequate as awindow into it.Ultimately, with some technical expertise, much more data is already publicly available and 


key: chroma:document
string_value:
to scrutinise a platform like TikTok and thus assess thepotential harms and impacts that its widespread usage entails, the Research API is grossly inadequate as awindow into it.Ultimately, with some technical expertise, much more data is already publicly available and accessible anyway.It shouldn’t take an in-house computer scientist with a PhD to obtain valuable insights into a social mediaplatform billions of people use. While it is reasonable for the platform to want to keep its inner workings secret,its potential impacts warrant profoundly wider and deeper access to the data generated by its users and aboutits users. That’s why the data we have obtained should not remain hidden behind a formidable technical wall.On the contrary, it should be made readily available to researchers, including those working within civil societyorganisations.Enjoy Reading This Article?Here are some more articles you might like to read next: Understanding TikTok's For You Feed Other search for … the opposition party TikToks Effect on Consumer Protection
ObjectVariablesComments6Users8Videos9
SourceVariablesDate collectedResearch API32July 6, 2023Web186July 6, 2023Android App845July 6, 2023
auditing TikTokblognewsaboutpublicationscode
© Copyright 2024 Stiftung Neue Verantwortung. Powered by Jekyll with al-folio theme. Legal notice.


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\Wikimedia Foundation Terms of Use - Wikimedia Foundation Governance Wiki.pdf


key: chroma:document
string_value:
Contents hideBeginningOverview1. Our Services2. Privacy Policy3. Content We Host4. Refraining from CertainActivities5. Password Security6. Trademarks7. Licensing of Content8. DMCA Compliance9. Third-party Websitesand Resources10. Management ofWebsites11. Resolutions andProject Policies12. API Terms13. Termination14. Disputes andJurisdiction15. Disclaimers16. Limitation on Liability17. Modiﬁcations to theseTerms of UseWikimedia Foundation Terms of UseAdd languages
PolicyDiscussionReadView sourceView historyTools
Appearance hideText
WidthSmallStandardLargeStandardWide
Shortcut:ToU
Shortcut:PAIDTranslate this pageOther languages:Afrikaans Bahasa Indonesia Bahasa Melayu Cymraeg Deutsch Deutsch (Sie-Form) EnglishEsperanto Fulfulde Gaeilge Hausa Igbo Kreyòl ayisyen Latina Lëtzebuergesch MaltiNederlands Qaraqalpaqsha Ripoarisch Runa Simi Schweizer Hochdeutsch Scots SesothoSunda Tagalog Tiếng Việt Türkçe Zazaki asturianu azərbaycanca bosanski catalàdansk eesti español euskara français français cadien føroyskt galego hrvatski italianokurdî latviešu lietuvių magyar norsk bokmål occitan polski português português do Brasilromână sardu shqip slovenčina slovenščina suomi svenska vèneto íslenska češtinaΕλληνικά башҡортса беларуская беларуская (тарашкевіца) български гӀалгӀай кыргызчамакедонски нохчийн русский српски / srpski тоҷикӣ українська ўзбекча հայերենייִדיש עברית $#"! الدارجة العربية بلوچی جهلسری ﻓﺎرﺳﯽ مصرى پښتو کوردی ܐܪܡܝܐ नेपालीमराठी िहन्दी অসমীয়া বাংলা ਪੰਜਾਬੀ ગુજરાતી த/ma_iMatratamil/llltamil /tlTE/tlLU/tlGU ಕನ#ಡ ತುಳ( മലയാളം ไทย ລາວပအိုဝ်ႏဘာႏသာႏ ြမန်မာဘာသာ მარგალური ქართული !"#ខ%រ ᱥᱟᱱᱛᱟᱲᱤ 中⽂ ޠ閩南語 / Bân-lâm-gú ꠍꠤꠟꠐꠤ ೠҴযWant to help translate? Translate the missing messages.
This policy is approved by the Wikimedia Foundation Board of Trustees.It may not be circumvented, eroded, or ignored by Wikimedia Foundationofﬁcers or staff nor local policies of any Wikimedia project.Please note that in the event of any differences in meaning orinterpretation between the original English version of this content and atranslation, the original English version takes precedence.Wikimedia Foundation Terms of UseThis is a summary of the Terms of Use. To read the fullterms, scroll down or click here.This is a human-readable summary of the Terms ofUse.Disclaimer: This summary is not a part of the Termsof Use and is not a legal document. It is simply ahandy reference for understanding the full terms.Think of it as the user-friendly interface to the legallanguage of our Terms of 


key: chroma:document
string_value:
ofUse.Disclaimer: This summary is not a part of the Termsof Use and is not a legal document. It is simply ahandy reference for understanding the full terms.Think of it as the user-friendly interface to the legallanguage of our Terms of Use.Part of our mission is to:Empower and Engage people around the world to collectand develop educational content and either publish it undera free license or dedicate it to the public domain.Disseminate this content effectively and globally, free ofcharge.Offer websites and technical infrastructure to help you dothis.You are free to:Read and Print our articles and other media free of charge.Share and Reuse our articles and other media under freeand open licenses.Contribute To and Edit our various websites or Projects.Under the following conditions:Responsibility — You take responsibility for your edits(since we only host your content).Civility — You support a civil environment and do notharass other users.Lawful Behavior — You do not violate copyright, postillegal content, or violate other applicable laws that followhuman rights principles.No Harm — You do not harm our technology infrastructureand you follow the policies for that infrastructure.Terms of Use and Policies — You adhere to the belowTerms of Use, to the Universal Code of Conduct, and to theapplicable community policies when you visit our websitesor Projects or participate in our communities.With the understanding that:You License Freely Your Contributions — You generallymust license your contributions and edits to our websites orProjects under a free and open license (unless yourcontribution is in the public domain).No Professional Advice — The content of articles onWikipedia and other Projects is for informational purposesonly and does not constitute professional advice.If you need help or you want to report a violation of theseTerms of Use you can:Ask for help on our Projects: Click "help" on the left sideof most pages.Ask for help by email: Contact experienced 


key: chroma:document
string_value:
does not constitute professional advice.If you need help or you want to report a violation of theseTerms of Use you can:Ask for help on our Projects: Click "help" on the left sideof most pages.Ask for help by email: Contact experienced volunteers forhelp by emailing info
wikimedia
org.Contact the Wikimedia Foundation: You can ﬁndinformation about how to reach us on our contact page.If you are a new contributor: You can ﬁnd project policiesto help learn how to use the Wikimedia Projects on pageslike the primer for newcomers.Our Terms of UseImagine a world in which every single human being can freely share in the sum of all knowledge. That's ourcommitment. – Our Vision StatementWelcome to Wikimedia! The Wikimedia Foundation, Inc. ("we" or "us" or "Foundation"), is a non-proﬁt charitableorganization, headquartered in San Francisco, California, United States, whose mission is to empower and engagepeople around the world to collect and develop content under a free license or in the public domain, and todisseminate it effectively and globally, free of charge.To support our vibrant community, we provide the essential infrastructure and organizational framework for thedevelopment of multilingual wiki projects and their editions (as explained on our Wikimedia Projects page) (herebyreferred to as "Projects") and other endeavors which serve this mission. We strive to make and keep educationaland informational content from the Projects available on the internet free of charge, in perpetuity.We welcome you ("you" or the "user") as a reader, or contributor of the Projects, and we encourage you to join theWikimedia community. Before you participate, however, we ask that you please read and agree to the followingTerms of Use ("Terms of Use").OverviewThese Terms of Use tell you about our public services at the Wikimedia Foundation, our relationship to you as auser, and the rights and responsibilities that guide us both. We host an incredible quantity 


key: chroma:document
string_value:
the followingTerms of Use ("Terms of Use").OverviewThese Terms of Use tell you about our public services at the Wikimedia Foundation, our relationship to you as auser, and the rights and responsibilities that guide us both. We host an incredible quantity of educational andinformational content, all of which is contributed and made possible by users like yourself. Generally we do notcontribute, monitor, or delete content (with rare exceptions, such as under policies like these Terms of Use, for legalcompliance, or when faced with urgent threats of serious harm). This means that editorial control is in the hands ofyou and your fellow users who create and manage the content.The community – the network of users who are constantly building and using the Projects and/or their websites(hereby referred to as "Project Websites") – is the principal means through which the goals of the mission areachieved. The community contributes to and helps govern our Projects and Project Websites. The community alsoundertakes the critical function of creating and enforcing policies for the speciﬁc Project editions (such as thedifferent language editions for the Wikipedia Project or the Wikimedia Commons multilingual edition).You, the user, are welcome to join as a contributor, editor, or author, but you should follow the policies that governeach of the independent Project editions, including the Universal Code of Conduct (UCoC), which apply to all Projecteditions. The largest of our Projects is Wikipedia, but we host other Projects too, each with different objectives andwork methods. Each Project edition has a team of contributors, editors or authors who work together to create andmanage the content on that Project edition. You are welcome to join these teams and work with them to improvethese Projects. Since we are dedicated to making content freely accessible to the public, content you contribute ismade available under a free license or 


key: chroma:document
string_value:
on that Project edition. You are welcome to join these teams and work with them to improvethese Projects. Since we are dedicated to making content freely accessible to the public, content you contribute ismade available under a free license or released in the public domain.Please be aware that you are legally responsible for all of your contributions, edits, and reuse of Wikimedia contentunder the laws of the United States of America and other applicable laws (which may include laws where you or thesubject of your contributions are located). This means it is important that you exercise caution when posting,modifying or reusing content. In light of this responsibility, we have some rules about what you cannot do, most ofwhich are either for your own protection or for the protection of other users like yourself. Please keep in mind thatthe content we host is for general informational purposes only, so if you need expert advice for a particular question(such as medical, legal, or ﬁnancial issues), you should seek the help of an appropriate professional. We alsoinclude other important notices and disclaimers, so please read these Terms of Use in their entirety.For clarity, other organizations, such as local Wikimedia chapters and associations, that may share in the samemission are nevertheless legally independent and separate from the Wikimedia Foundation. Unless otherwise statedby the Foundation as an authorized party on a given Project's Website, those other organizations have noresponsibility for the operations of the Project's Website or its content.1. Our ServicesThe Wikimedia Foundation is dedicated to encouraging the growth, development, and distribution of free multilingualcontent, and to hosting the full content of these wiki-based Projects for the public free of charge. Our role is to hostsome of the largest collaboratively edited reference Projects in the world, which can be found here. However, weact only as 


key: chroma:document
string_value:
and to hosting the full content of these wiki-based Projects for the public free of charge. Our role is to hostsome of the largest collaboratively edited reference Projects in the world, which can be found here. However, weact only as a hosting service provider, maintaining the infrastructure and organizational framework. Thisinfrastructure and framework allow our users to build the Projects by contributing and editing content themselves.They also allow our users to reuse that content. The infrastructure we maintain includes specialized technologicalinfrastructure that enables users to programmatically interact with and reuse content on Projects (referred to as"Application Programming Interface" or "APIs"), and mobile applications.As used throughout the rest of the Terms of Use, our services consist of: The Project Websites we host,technological infrastructure that we maintain, and any technical spaces that we host for the maintenance andimprovement of our Projects.Because of our unique role, there are a couple of things you should be aware of when considering our relationshipto you, the Projects, and other users:a. We do not take an editorial role: Because the Projects are collaboratively edited, the vast majority of thecontent that we host is provided by users, and we do not take an editorial role. This means that we generallydo not monitor or edit the content of the Project Websites, and we do not take any responsibility for thiscontent. Similarly, unless we have expressly stated otherwise, we do not endorse any opinions expressed viaour services, and we do not represent or guarantee the truthfulness, accuracy, or reliability of any submittedcommunity content on the Projects.b. You are responsible for your own actions: You are legally responsible for your edits and contributions onthe Projects, your reuse of content on the Projects, your use of the APIs, and your use of our services moregenerally. For your own protection you should exercise 


key: chroma:document
string_value:
your own actions: You are legally responsible for your edits and contributions onthe Projects, your reuse of content on the Projects, your use of the APIs, and your use of our services moregenerally. For your own protection you should exercise caution and avoid taking any actions that may resultin criminal or civil liability under any applicable laws. For clarity, applicable law includes at least the laws ofthe United States of America and the State of California. For other countries, this is determined on a case-by-case basis. Although we may not agree with such actions, we warn users—particularly the editors,contributors, and authors—that non-U.S. authorities may seek to apply other country laws to you, includinglocal laws where you live or where you view or edit content. We generally cannot offer any protection,guarantee, immunity or indemniﬁcation against the application of such laws.2. Privacy PolicyWe ask that you review the terms of our Privacy Policy, so that you are aware of how we collect and use yourinformation.3. Content We Hosta. You may ﬁnd some material objectionable or erroneous: Because we host a wide array of content that isproduced or gathered by fellow users, you may encounter material that you ﬁnd offensive, erroneous,misleading, mislabeled, or otherwise objectionable. We therefore ask that you use common sense andproper judgment when using our services.b. The Projects' content is for general informational purposes only: Although our Projects host a greatdeal of information that pertains to professional topics, including medical, legal, or ﬁnancial issues, thiscontent is presented for general informational purposes only. It should not be taken as professional advice.Please seek independent professional counseling from someone who is licensed or qualiﬁed in theapplicable area in lieu of acting on any information, opinion, or advice contained in one of the ProjectWebsites.4. Refraining from Certain ActivitiesThe Projects hosted by the Wikimedia Foundation 


key: chroma:document
string_value:
seek independent professional counseling from someone who is licensed or qualiﬁed in theapplicable area in lieu of acting on any information, opinion, or advice contained in one of the ProjectWebsites.4. Refraining from Certain ActivitiesThe Projects hosted by the Wikimedia Foundation only exist because of the vibrant community of users like you whocollaborate to write, edit, and curate the content. We happily welcome your participation in this community. Weencourage you to be civil and polite in your interactions with others in the community, to act in good faith, and tomake edits and contributions aimed at furthering the mission of the shared Project. We ask that all users review andfollow the Universal Code of Conduct ("UCoC"), which lays out requirements for collegial, civil collaboration acrossall Projects that we host.Certain activities, whether legal or illegal under the applicable law, may be harmful to other users and violate ourrules, and some activities may also subject you to liability. Therefore, for your own protection and for that of otherusers, you may not engage in such activities on, or otherwise using, our Projects. These activities include:Harassing and Abusing OthersEngaging in threats, stalking, spamming, vandalism, or harassment as described in the UCoC;Transmitting chain mail, junk mail, or spam to other users;Posting or modifying content with the intention to seriously harm others, such as deliberate inducementsto self-harm, or deliberate triggering of epilepsy.Violating the Privacy of OthersInfringing the privacy rights of others under the laws of the United States of America or other applicablelaws (which may include the laws where you live or where you view or edit content);Soliciting personally identiﬁable information for the purposes of harassment, exploitation, or violation ofprivacy, or for any promotional or commercial purpose not explicitly approved by the WikimediaFoundation; andSoliciting personally identiﬁable information from anyone under the age of 18 years, or under the 


key: chroma:document
string_value:
personally identiﬁable information for the purposes of harassment, exploitation, or violation ofprivacy, or for any promotional or commercial purpose not explicitly approved by the WikimediaFoundation; andSoliciting personally identiﬁable information from anyone under the age of 18 years, or under the age ofmajority where you are if higher than 18 years, for an illegal purpose or violating any applicable lawregarding the health or well-being of minors.Engaging in False Statements, Impersonation, or FraudIntentionally or knowingly posting content that constitutes libel or defamation under the laws of the UnitedStates of America;Posting or modifying content with the intent to deceive or mislead others;Attempting to impersonate another user or individual, misrepresenting your afﬁliation with any individualor entity, hiding your afﬁliation with any individual or entity when disclosure is required by these terms orlocal Project policy, or using the name or username of another person with the intent to deceive; andEngaging in fraud.Committing Infringement of Intellectual Property RightsInfringing copyrights, trademarks, patents, or other proprietary rights under the applicable law.Misusing Our Services for Other Illegal PurposesPosting child pornography or any other content that violates applicable law concerning child pornographyor child sexual abuse material, or encouraging, grooming, or advocating for others to create or sharesuch material;Posting or trafﬁcking in obscene material that is unlawful under applicable law; andUsing the services in a manner that is inconsistent with applicable law.Engaging in Disruptive and Illegal Misuse of FacilitiesPosting or distributing content that contains any viruses, malware, worms, Trojan horses, malicious code,or other device that could harm our technical infrastructure or system or that of other users;Engaging in automated uses of the Project Websites that are abusive or disruptive of the services, violateacceptable usage policies where available, or have not been approved by the Wikimedia community;Disrupting the services by placing an undue burden on an API, Project Website or the networks 


key: chroma:document
string_value:
the Project Websites that are abusive or disruptive of the services, violateacceptable usage policies where available, or have not been approved by the Wikimedia community;Disrupting the services by placing an undue burden on an API, Project Website or the networks orservers connected with a particular Project Website;Disrupting the services by inundating any of the Project Websites with communications or other trafﬁcthat suggests no serious intent to use the Project website for its stated purpose;Knowingly accessing, tampering with, or using any of our non-public areas in our computer systemswithout authorization; andProbing, scanning, or testing the vulnerability of any of our technical systems or networks unless all thefollowing conditions are met:such actions do not unduly abuse or disrupt our technical systems or networks;such actions are not for personal gain (except for credit for your work);you report any vulnerabilities to the relevant developers (or ﬁx it yourself); andyou do not undertake such actions with malicious or destructive intent.Paid Contributions Without DisclosureYou must disclose each and any employer, client, intended beneﬁciary and afﬁliation withrespect to any contribution for which you receive, or expect to receive, compensation. You must makethat disclosure in at least one of the following ways:a statement on your user page,a statement on the talk page accompanying any paid contributions, ora statement in the edit summary accompanying any paid contributions.In addition, if you make a public posting off the Projects advertising editing services on Wikipedia inexchange for compensation of any kind, you must disclose all Wikipedia accounts you have used or willuse for this service in the public posting on the third-party service.Applicable law, or Project-speciﬁc policies and Foundation policies and guidelines, such as thoseaddressing conﬂicts of interest, may further limit paid contributions or require more detailed disclosure.For example, infringing Wikimedia Trademarks (deﬁned hereinafter at Section 6) to advertise paid editingservices, removing 


key: chroma:document
string_value:
service.Applicable law, or Project-speciﬁc policies and Foundation policies and guidelines, such as thoseaddressing conﬂicts of interest, may further limit paid contributions or require more detailed disclosure.For example, infringing Wikimedia Trademarks (deﬁned hereinafter at Section 6) to advertise paid editingservices, removing disclosures on previously adequately disclosed paid edits, or logged-out paid editingin a manner that makes adequate disclosure a practical impossibility violate this section.A Wikimedia Project community may adopt an alternative paid contribution disclosure policy which maysupplement or replace this section. If a Project adopts an alternative disclosure policy, you may complywith that policy instead of the requirements in this section (titled "Paid Contributions Without Disclosure")when contributing to that particular Project.For more information, please read our FAQ on disclosure of paid contributions.We reserve the right to exercise our enforcement discretion with respect to the provisions in section 4 of theseTerms of Use. Where required, enforcement of these terms may include actions not listed in the WikimediaFoundation Ofﬁce Action Policy. If enforcement is required in new circumstances, we will make an effort within atmost one (1) year to update the Ofﬁce Action Policy to catalog the new type of action.Marketing Company MediationsUndisclosed editing by users receiving compensation creates an unreasonable burden on volunteer editors whoinvestigate and enforce community policies. Therefore, for violations of this section related to undisclosed paidediting, you agree to submit to binding "Med-Arb" (a "Marketing Company Mediation") as described in section 14 ofthese Terms of Use.5. Password SecurityYou are responsible for safeguarding your own password and other security credentials, and should never disclosethem to any third party.6. TrademarksAlthough you have considerable freedoms for reuse of the content on the Project Websites, it is important that, atthe Wikimedia Foundation, we protect our trademark rights so that we can protect our users from fraudulentimpersonators. Because of this, we ask that you 


key: chroma:document
string_value:
have considerable freedoms for reuse of the content on the Project Websites, it is important that, atthe Wikimedia Foundation, we protect our trademark rights so that we can protect our users from fraudulentimpersonators. Because of this, we ask that you please respect our trademarks. All Wikimedia Foundationtrademarks belong to the Wikimedia Foundation, and any use of our trade names, trademarks, service marks, logos,or domain names must be in compliance with these Terms of Use and in compliance with our Trademark Policy.7. Licensing of ContentTo grow the commons of free knowledge and free culture, all users contributing to the Projects or Project Websitesare required to grant broad permissions to the general public to redistribute and reuse their contributions freely, solong as that use is properly attributed and the same freedom to reuse and redistribute is granted to any derivativeworks. In keeping with our goal of providing free information to the widest possible audience, we require that whennecessary all submitted content be licensed so that it is freely reusable by anyone who may access it.You agree to the following licensing requirements:a. Text to which you hold the copyright: When you submit text to which you hold the copyright, you agree tolicense it under:Creative Commons Attribution-ShareAlike 4.0 International License ("CC BY-SA 4.0"), andGNU Free Documentation License ("GFDL") (unversioned, with no invariant sections, front-cover texts,or back-cover texts).Reusers may comply with either license or both.The only exception is if the Project edition or feature requires a different license. In that case, you agree tolicense any text you contribute under the particular license prescribed by the Project edition or the feature.Please note that these licenses do allow commercial uses of your contributions, as long as such uses arecompliant with the terms of the respective licenses. Where you own Sui Generis Database Rights covered byCC BY-SA 4.0, 


key: chroma:document
string_value:
Project edition or the feature.Please note that these licenses do allow commercial uses of your contributions, as long as such uses arecompliant with the terms of the respective licenses. Where you own Sui Generis Database Rights covered byCC BY-SA 4.0, you waive these rights. As an example, this means facts you contribute to the projects maybe reused freely without attribution.b. Attribution: Attribution is an important part of these licenses. We consider it giving credit where credit is due– to authors like yourself. When you contribute text, you agree to be attributed in any of the followingfashions:i. Through hyperlink (where possible) or URL to the article to which you contributed (since each articlehas a history page that lists all contributors, authors and editors);ii. Through hyperlink (where possible) or URL to an alternative, stable online copy that is freelyaccessible, which conforms with the relevant license, and which provides credit to the authors in amanner equivalent to the credit given on the Project Website; oriii. Through a list of all authors (but please note that any list of authors may be ﬁltered to exclude verysmall or irrelevant contributions).c. Importing text: You may import text that you have found elsewhere or that you have co-authored withothers, but in such case you represent and warrant that the text is available under terms that are compatiblewith CC BY-SA (or, as explained above, another license when exceptionally required by the Project edition orfeature). For a list of compatible licenses, see Creative Commons. You shall not import content that isavailable solely under GFDL.You agree that, if you import text under a CC license that requires attribution, you must credit the author(s) ina reasonable fashion. Where such credit is commonly given through page histories (such as Wikimedia-internal copying), it is sufﬁcient to give attribution in the edit summary, which 


key: chroma:document
string_value:
text under a CC license that requires attribution, you must credit the author(s) ina reasonable fashion. Where such credit is commonly given through page histories (such as Wikimedia-internal copying), it is sufﬁcient to give attribution in the edit summary, which is recorded in the page history,when importing the text. The attribution requirements are sometimes too intrusive for particularcircumstances (regardless of the license), and there may be instances where the Wikimedia communitydecides that imported text cannot be used for that reason.d. Non-text media: Non-text media on the Projects are available under a variety of different licenses thatsupport the general goal of allowing unrestricted reuse and redistribution. When you contribute non-textmedia, you agree to comply with the requirements for such licenses as described in our Licensing Policy, andalso comply with the requirements of the speciﬁc Project edition or feature to which you are contributing. Alsosee the Wikimedia Commons Licensing Policy for more information on contributing non-text media toWikimedia Commons.e. No revocation of license: Except as consistent with your license, you agree that you will not unilaterallyrevoke or seek invalidation of any license that you have granted under these Terms of Use for text content ornon-text media contributed to the Projects or features, even if you terminate use of our services.f. Public domain content: Content that is in the public domain is welcome. It is important however that youconﬁrm the public domain status of the content under the law of the United States of America as well as thelaws of any other countries as required by the speciﬁc Project edition. When you contribute content that is inthe public domain, you warrant that the material is actually in the public domain, and you agree to label itappropriately.g. Re-use: Reuse of content that we host is welcome, though exceptions exist for content contributed under"fair use" 


key: chroma:document
string_value:
content that is inthe public domain, you warrant that the material is actually in the public domain, and you agree to label itappropriately.g. Re-use: Reuse of content that we host is welcome, though exceptions exist for content contributed under"fair use" or similar exemptions under applicable copyright law. Any reuse must comply with the underlyinglicense(s).When you reuse or redistribute a text page developed by the Wikimedia community, you agree to attributethe authors in any of the following fashions:i. Through hyperlink (where possible) or URL to the page or pages that you are reusing (since eachpage has a history page that lists all contributors, authors and editors);ii. Through hyperlink (where possible) or URL to an alternative, stable online copy that is freelyaccessible, which conforms with the license, and which provides credit to the authors in a mannerequivalent to the credit given on the Project Website; oriii. Through a list of all authors (but please note that any list of authors may be ﬁltered to exclude verysmall or irrelevant contributions).If the text content was imported from another source, it is possible that the content is licensed under acompatible CC BY-SA license but not GFDL (as described in "Importing text," above). In that case, you agreeto comply with the compatible CC BY-SA license and do not have the option to relicense it under GFDL. Todetermine the license that applies to the content that you seek to reuse or redistribute, you should review thepage footer, page history, and discussion page.In addition, please be aware that text that originated from external sources and was imported into a Projectmay be under a license that attaches additional attribution requirements. Users agree to indicate theseadditional attribution requirements clearly. Depending on the Project, such requirements may appear, forexample, in a banner or other notations pointing out that some or all 


key: chroma:document
string_value:
a Projectmay be under a license that attaches additional attribution requirements. Users agree to indicate theseadditional attribution requirements clearly. Depending on the Project, such requirements may appear, forexample, in a banner or other notations pointing out that some or all of the content was originally publishedelsewhere. Where there are such visible notations, reusers should preserve them.For any non-text media, you agree to comply with the applicable license under which the work has beenmade available (which can be discovered by clicking on the work and looking at the licensing section on itsdescription page or reviewing an applicable source page for that work). When reusing any content that wehost, you agree to comply with the relevant attribution requirements as they pertain to the underlying licenseor licenses.h. Modiﬁcations or additions to material that you reuse: When modifying or making additions to text thatyou have obtained from a Project Website, you agree to license the modiﬁed or added content under CC BY-SA 4.0 or later (or, as explained above, another license when exceptionally required by the speciﬁc Projectedition or feature).When modifying or making additions to any non-text media that you have obtained from a Project website,you agree to license the modiﬁed or added content in accordance with whatever license under which thework has been made available.With both text content and non-text media, you agree to clearly indicate that the original work has beenmodiﬁed. If you are reusing text content in a wiki, it is sufﬁcient to indicate in the page history that you madea change to the imported text. For each copy or modiﬁed version that you distribute, you agree to include alicensing notice stating which license the work is released under, along with either a hyperlink or URL to thetext of the license or a copy of the license itself.8. DMCA ComplianceThe Wikimedia 


key: chroma:document
string_value:
version that you distribute, you agree to include alicensing notice stating which license the work is released under, along with either a hyperlink or URL to thetext of the license or a copy of the license itself.8. DMCA ComplianceThe Wikimedia Foundation wants to ensure that the content that we host can be reused by other users without fearof liability and that it is not infringing the proprietary rights of others. In fairness to our users, as well as to othercreators and copyright holders, our policy is to respond to notices of alleged infringement that comply with theformalities of the Digital Millennium Copyright Act ("DMCA"). Pursuant to the DMCA, we will terminate, inappropriate circumstances, users and account holders of our system and network who are repeat infringers on ourProjects and services.However, we also recognize that not every takedown notice is valid or in good faith. In such cases, we stronglyencourage users to ﬁle counter-notiﬁcations when they appropriately believe a DMCA takedown demand is invalid orimproper. For more information on what to do if you think a DMCA notice has been improperly ﬁled, you may wish toconsult the Lumen Database website.If you are the owner of content that is being improperly used on one of the Projects without your permission, youmay request that the content be removed by ﬁling a notice under the DMCA. To make such a request, please emailus at legal
wikimedia
org or snail mail our designated agent.Alternatively, you may make a request to our community, which often handles copyright issues faster and moreeffectively than the process prescribed under the DMCA. In that case, you can post a notice explaining yourcopyright concerns. For a non-exhaustive and non-authoritative list of the relevant processes for the different Projecteditions, visit the Copyright Problems page. Before ﬁling a DMCA claim, you also have the option 


key: chroma:document
string_value:
In that case, you can post a notice explaining yourcopyright concerns. For a non-exhaustive and non-authoritative list of the relevant processes for the different Projecteditions, visit the Copyright Problems page. Before ﬁling a DMCA claim, you also have the option of sending anemail to the community at info
wikimedia
org.9. Third-party Websites and ResourcesYou are solely responsible for your use of any third-party websites or resources. Although the Projects and ProjectWebsites contain links to third-party websites and resources, we do not endorse and are not responsible or liable fortheir availability, accuracy, or the related content, products, or services (including, without limitation, any viruses orother disabling features), nor do we have any obligation to monitor such third-party content.10. Management of WebsitesThe community has the primary role in creating and enforcing policies applying to the different Project editions. Atthe Wikimedia Foundation, we rarely intervene in community decisions about policy and its enforcement.It is possible to notify us of illegal content, or content that violates our Terms of Use (including all policies and otherdocuments incorporated by reference) for other reasons by contacting us directly. However, you can typically makea request directly to the Project's community: this may be more efﬁcient, and is more consistent with our Projects'aim to empower the user community.Each Project will usually provide "Help" or "Contact" pages for further guidance, or speciﬁc tools for reporting issues.Alternatively – if in doubt – you can ask members of the community for help, by sending an email toinfo
wikimedia
org or a more language-speciﬁc address from the Volunteer Response Team page. Please note thatthese mailboxes are monitored by users of the Projects, not the Foundation. As a result, they should not bethreatened or issued with legal demands.If you contact the Foundation with a problem, we will typically explore whether and how existing community-ledmechanisms can investigate and, where 


key: chroma:document
string_value:
by users of the Projects, not the Foundation. As a result, they should not bethreatened or issued with legal demands.If you contact the Foundation with a problem, we will typically explore whether and how existing community-ledmechanisms can investigate and, where appropriate, resolve it.In an unusual case, the need may arise, or the community may ask us, to address an especially problematic user orespecially problematic content because of signiﬁcant Project disturbance or dangerous behavior. In such cases, wereserve the right, at our sole discretion (or where legally compelled), to:Investigate your use of the Projects or our services (a) to determine whether a violation of these Terms of Use,Project edition policy, or other applicable law or policy has occurred, or (b) to comply with any applicable law,legal process, or an appropriate governmental request;Detect, prevent, or otherwise address fraud, false or unveriﬁable information, security, or technical issues orrespond to user support requests;Refuse, revert, disable, or restrict access to contributions of any user who violates these Terms of Use;Ban a user from editing or contributing or block a user's account or access for actions violating these Terms ofUse, including repeat posting of unlawful material under applicable law in line with human rights principles;Take legal action against users who violate these Terms of Use (including reports to law enforcementauthorities); andManage otherwise the Project websites in a manner designed to facilitate their proper functioning and protect therights, property, and safety of ourselves and our users, licensors, partners, and the public.Those Foundation moderation activities may be informed or performed by software (such as trafﬁc ﬂood ("Denial ofService") protection). In those cases human review is normally available, upon request.In the interests of our users and the Projects, in the extreme circumstance that any individual has had their accountor access blocked under this section, they are prohibited from creating 


key: chroma:document
string_value:
protection). In those cases human review is normally available, upon request.In the interests of our users and the Projects, in the extreme circumstance that any individual has had their accountor access blocked under this section, they are prohibited from creating or using another account on or seekingaccess to the same Project, unless we provide explicit permission. Without limiting the authority of the community,the Foundation itself will not ban a user from editing or contributing or block a user's account or access solelybecause of good faith criticism that does not result in actions otherwise violating these Terms of Use or communitypolicies.The Wikimedia community and its members may also take action when so allowed by the community or Foundationpolicies applicable to the speciﬁc Project edition, including but not limited to warning, investigating, blocking, orbanning users who violate those policies. You agree to comply with the ﬁnal decisions of dispute resolution bodiesthat are established by the community for the speciﬁc Project editions (such as arbitration committees); thesedecisions may include sanctions as set out by the policy of the speciﬁc Project edition.Especially problematic users who have had accounts or access blocked on multiple Project editions may be subjectto a ban from all of the Project editions, in accordance with the Global Ban Policy. In contrast to Board resolutions orthese Terms of Use, policies established by the community, which may cover a single Project edition or multipleProjects editions (like the Global Ban Policy), may be modiﬁed by the relevant community according to its ownprocedures.The blocking of an account or access or the banning of a user under this provision shall be in accordance withSection 13 of these Terms of Use.If you believe we have not satisfactorily acted on a problematic content report, or if you have been subjected to aFoundation moderation action that you wish 


key: chroma:document
string_value:
user under this provision shall be in accordance withSection 13 of these Terms of Use.If you believe we have not satisfactorily acted on a problematic content report, or if you have been subjected to aFoundation moderation action that you wish to challenge, you may be able to submit an appeal. Other informationabout routes of appeal may also be explained to you at the time, or in Project-speciﬁc help pages.We reserve the right to suspend (temporarily, or permanently) our handling of reports or other correspondence fromusers or third parties, whether about allegedly illegal or otherwise problematic content or conduct, or requestingappeals against moderation actions, if such correspondence was made in bad faith, repetitive, unfounded, and/orabusive. In appropriate circumstances, your email address may even be blocked on our email system(s), and youwill then need to contact us at our postal address if you wish to further correspond with us during that block. For lessserious cases (e.g. up to three polite emails about one or more meritless complaints), this is likely to be temporary.More frequent or more abusive communications are more likely to lead to permanent measures.11. Resolutions and Project PoliciesThe Wikimedia Foundation Board of Trustees releases ofﬁcial policies from time to time. Some of these policies maybe mandatory for a particular Project or Project edition, and, when they are, you agree to abide by them asapplicable.12. API TermsWe make available a set of APIs, which include documentation and associated tools, to enable users to buildproducts that promote free knowledge. By using our APIs, you agree to abide by all applicable policies governing theuse of the APIs, which include but are not limited to the User-Agent Policy, the Robot Policy, and the API:Etiquette(collectively, "API Documentation"), which are incorporated into these Terms of Use by reference.13. TerminationThough we hope you will stay and continue 


key: chroma:document
string_value:
theuse of the APIs, which include but are not limited to the User-Agent Policy, the Robot Policy, and the API:Etiquette(collectively, "API Documentation"), which are incorporated into these Terms of Use by reference.13. TerminationThough we hope you will stay and continue to contribute to the Projects, you can stop using our services any time.In certain (hopefully unlikely) circumstances it may be necessary for either ourselves or the Wikimedia community orits members (as described in Section 10) to terminate part or all of our services, terminate these Terms of Use, blockyour account or access, or ban you as a user. If your account or access is blocked or otherwise terminated for anyreason, your public contributions and a record of your activities on or in relation to the Projects (including anycorrespondence you have sent us) will be unaffected (subject to applicable policies), and you may still access ourpublic pages for the sole purpose of reading publicly available content on the Projects. In such circumstances,however, you may not be able to access your account or settings. However, regardless of any other provision inthese Terms of Use, we reserve the right to suspend or end the services at any time, with or without cause, and withor without notice. Even after your use and participation are banned, blocked or otherwise suspended, these Terms ofUse will remain in effect with respect to relevant provisions, including Sections 1, 3, 4, 6, 7, 9-16, and 18.14. Disputes and JurisdictionHighlighted for emphasisWe hope that no serious disagreements arise involving you, but, in the event there is a dispute, we encourage youto seek resolution through the dispute resolution procedures or mechanisms provided by the Projects or Projecteditions and the Wikimedia Foundation. If you seek to ﬁle a legal claim against us, you agree to ﬁle and resolve itexclusively in a state 


key: chroma:document
string_value:
youto seek resolution through the dispute resolution procedures or mechanisms provided by the Projects or Projecteditions and the Wikimedia Foundation. If you seek to ﬁle a legal claim against us, you agree to ﬁle and resolve itexclusively in a state or federal court located in San Francisco County, California. You also agree that the laws of theState of California and, to the extent applicable, the laws of the United States of America will govern these Terms ofUse, as well as any legal claim that might arise between you and us (without reference to conﬂict of laws principles).You agree to submit to the personal jurisdiction of, and agree that venue is proper in, the courts located in SanFrancisco County, California, in any legal action or proceeding relating to us or these Terms of Use.To ensure that disputes are dealt with soon after they arise, you agree that regardless of any statute or law to thecontrary, any claim or cause of action you might have arising out of or related to use of our services or these Termsof Use must be ﬁled within the applicable statute of limitations or, if earlier, one (1) year after the pertinent factsunderlying such claim or cause of action could have been discovered with reasonable diligence (or be foreverbarred).Marketing Company Mediations As described in section 4 of these Terms of Use, you agree to resolve violationsof the Paid Contributions without Disclosure in a Marketing Company Mediation at the Foundation's discretion.Marketing Company Mediations are binding mediations where, at the end of either a half or full day session, anydisputed items that remain unresolved will be decided by the mediator in a legally binding decision. They will beconducted in meetings by teleconference or videoconference. If an in-person meeting is required, then theMarketing Company Mediation will take place in San 


key: chroma:document
string_value:
anydisputed items that remain unresolved will be decided by the mediator in a legally binding decision. They will beconducted in meetings by teleconference or videoconference. If an in-person meeting is required, then theMarketing Company Mediation will take place in San Francisco County, California. The parties will split all fees andexpenses related to the mediation/arbitration equally.You agree, as part of a Marketing Company Mediation, to cooperate with the Foundation, including by timelyproviding any documentation in your possession relating to your undisclosed paid editing activities including theaccounts used, articles affected, and clients who purchased such services.Marketing Company Mediations are subject to and governed by the Federal Arbitration Act to the extent that themediator becomes an arbitrator. The prevailing party shall be entitled to recover its attorneys' fees (including all feesnecessary to determine the applicability of the Marketing Company Mediation and to enforce the binding result) andall costs relating to the investigation and enforcement of its rights. A party may be deemed "prevailing" even if it isnot successful on every claim asserted.If for some reason the entirety of these Marketing Company Mediation requirements are found to be unenforceable,you agree to resolve any disputes as described in the beginning of this section.15. DisclaimersHighlighted for emphasisAt the Wikimedia Foundation, we do our best to provide educational and informational content to a very wideaudience, but your use of our services is at your sole risk. We provide these services on an "as is" and "as available"basis, and we expressly disclaim all express or implied warranties of all kinds, including but not limited to the impliedwarranties of merchantability, ﬁtness for a particular purpose, and non-infringement. We make no warranty that ourservices will meet your requirements, be safe, secure, uninterrupted, timely, accurate, or error-free, or that yourinformation will be secure.Search
Search Wikimedia Foundation Governance Wiki
EnglishDonateLog inPrivacy policyAbout Wikimedia Foundation 


key: chroma:document
string_value:
merchantability, ﬁtness for a particular purpose, and non-infringement. We make no warranty that ourservices will meet your requirements, be safe, secure, uninterrupted, timely, accurate, or error-free, or that yourinformation will be secure.Search
Search Wikimedia Foundation Governance Wiki
EnglishDonateLog inPrivacy policyAbout Wikimedia Foundation Governance WikiDisclaimersCode of ConductDevelopersStatisticsCookie statementMobile viewThis page was last edited on 30 March 2024, at 07:20.Text is available under the Creative Commons Attribution-ShareAlike License; additional terms may apply. See Terms of Use for details.information will be secure.We are not responsible for the content, data, or actions of third parties, and you release us, our directors, ofﬁcers,employees, and agents from any claims and damages, known and unknown, arising out of or in any way connectedwith any claim you have against any such third parties. No advice or information, whether oral or written, obtained byyou from us or through or from our services creates any warranty not expressly stated in these Terms of Use.Any material downloaded or otherwise obtained through your use of our services is done at your own discretion andrisk, and you will be solely responsible for any damage to your computer system or loss of data that results from thedownload of any such material. You agree that we have no responsibility or liability for the deletion of, or the failureto store or to transmit, any content or communication maintained by the service. We retain the right to create limitson use and storage at our sole discretion at any time with or without notice.Some states or jurisdictions do not allow the types of disclaimers in this section, so they may not apply to you eitherin part or in full depending on the law.16. Limitation on LiabilityHighlighted for emphasisThe Wikimedia Foundation will not be liable to you or to any other party for any direct, indirect, incidental, special,consequential or exemplary damages, 


key: chroma:document
string_value:
not apply to you eitherin part or in full depending on the law.16. Limitation on LiabilityHighlighted for emphasisThe Wikimedia Foundation will not be liable to you or to any other party for any direct, indirect, incidental, special,consequential or exemplary damages, including but not limited to, damages for loss of proﬁts, goodwill, use, data, orother intangible losses, regardless of whether we were advised of the possibility of such damage. In no event shallour liability exceed one thousand U.S. dollars (US$1,000.00) in aggregate. In the case that applicable law may notallow the limitation or exclusion of liability or incidental or consequential damages, the above limitation or exclusionmay not apply to you, although our liability will be limited to the fullest extent permitted by applicable law.17. Modifications to these Terms of UseJust as the Wikimedia community's input is essential for the growth and maintenance of the Projects, we believe thatcommunity input is essential for these Terms of Use to properly serve our users. It is also essential for a faircontract. Therefore, we will provide these Terms of Use, as well as any substantial future revisions of these Terms ofUse, to the community for comment at least thirty (30) days before the end of the comment period. If a futureproposed revision is substantial, we will provide an additional 30 days for comments after posting a translation of theproposed revision in at least three languages (selected at our discretion). The community will be encouraged totranslate the proposed revision in other languages as appropriate. For changes for legal or administrative reasons,to correct an inaccurate statement, or changes in response to community comments, we will provide at least three(3) days' notice.Because it may be necessary to modify these Terms of Use from time to time, we will provide notice of suchmodiﬁcations and the opportunity to comment via 


key: chroma:document
string_value:
changes in response to community comments, we will provide at least three(3) days' notice.Because it may be necessary to modify these Terms of Use from time to time, we will provide notice of suchmodiﬁcations and the opportunity to comment via the Project websites, and via a notiﬁcation onWikimediaAnnounce-l. However, we ask that you please periodically review the most up-to-date version of theseTerms of Use. Your continued use of our services after the new Terms of Use become ofﬁcial following the noticeand review period constitutes an acceptance of these Terms of Use on your part. For the protection of the WikimediaFoundation and other users like yourself, if you do not agree with our Terms of Use, you cannot use our services.18. Other TermsThese Terms of Use do not create an employment, agency, partnership, joint control or joint venture relationshipbetween you and us, the Wikimedia Foundation. For the purposes of European Economic Area law, United Kingdomlaw, or other laws that involve a similar concept, you are not acting "under the authority of" the Foundation when youuse the services. If you have not signed a separate agreement with us, these Terms of Use are the entire agreementbetween you and us. If there is any conﬂict between these Terms of Use and a signed written agreement betweenyou and us, the signed agreement will control.You agree that we may provide you with notices, including those regarding changes to the Terms of Use, by email,regular mail, or postings on the Projects or Project Websites.If in any circumstance, we do not apply or enforce any provision of these Terms of Use, it is not a waiver of thatprovision.You understand that, unless otherwise agreed to in writing by us, you have no expectation of compensation for anyactivity, contribution, or idea that you provide to us, the community, or 


key: chroma:document
string_value:
these Terms of Use, it is not a waiver of thatprovision.You understand that, unless otherwise agreed to in writing by us, you have no expectation of compensation for anyactivity, contribution, or idea that you provide to us, the community, or the Projects or Project editions.Notwithstanding any provision to the contrary in these Terms of Use, we (the Wikimedia Foundation) and you agreenot to modify the applicable terms and requirements of any free license that is employed on the Projects or Projecteditions when such free license is authorized by these Terms of Use.These Terms of Use were written in English (U.S.). While we hope that translations of these Terms of Use areaccurate, in the event of any differences in meaning between the original English version and a translation, theoriginal English version takes precedence.If any provision or part of a provision of these Terms of Use is found unlawful, void, or unenforceable, that provisionor part of the provision is deemed severable from these Terms of Use and will be enforced to the maximum extentpermissible, and all other provisions of these Terms of Use will remain in full force and effect.Thank You!We appreciate your taking the time to read these Terms of Use, and we are very happy to have you contributing tothe Projects and using our services. Through your contributions, you are helping to build something really big – notonly an important collection of collaboratively edited reference Projects that provides education and information tomillions who might otherwise lack access, but also a vibrant community of like-minded and engaged peers, focusedon a very noble goal.These Terms of Use went into effect on June 7, 2023. Previous versions of the terms:Terms of Use (2014–2023): effective from June 16, 2014, until June 7, 2023Terms of Use (2012–2014): effective from May 24, 2012, until June 16, 


key: chroma:document
string_value:
noble goal.These Terms of Use went into effect on June 7, 2023. Previous versions of the terms:Terms of Use (2014–2023): effective from June 16, 2014, until June 7, 2023Terms of Use (2012–2014): effective from May 24, 2012, until June 16, 2014Terms of Use (2009): effective from 2009 until May 24, 2012Please note that in the event of any differences in meaning or interpretation between the original Englishversion of this content and a translation, the original English version takes precedence.Categories: PoliciesTerms of Use


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\Wikipedia_Tools - Wikipedia.pdf


key: chroma:document
string_value:
Privacy policyAbout WikipediaDisclaimersContact WikipediaCode of ConductDevelopersStatisticsCookie statementMobile viewThis page was last edited on 25 October 2024, at 10:28 (UTC).Text is available under the Creative Commons Attribution-ShareAlike 4.0 License; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy. Wikipedia® is a registered trademark of the Wikimedia Foundation, Inc., a non-proﬁt organization.Contents hide(Top)Browsing and editingSearchingGoogle tools
VeriﬁcationPage histories
User edit counts andanalysis
Importing (converting)content to Wikipedia(MediaWiki) format
Export: Conversion toother formatsGeotagging-related toolsGadget developersOtherSee alsoReferencesWikipedia:Tools41 languages
Project pageTalkReadView sourceView historyTools
Appearance hideText
WidthColor (beta)SmallStandardLargeStandardWideAutomaticLightDarkShortcutsWP:TOOLWP:TOOLS
[show]V · T · E[show]V · T · EEditor toolsEditing aidsAlt textCopyvio detectorPeer reviewDab solverDisambig linksRedirect checkCitation toolsCiterBiomedical citeCitation botDup detectorMakeRefReﬁllWayBackWeb2CitThings to reviewCopyviosNew pagesNew ﬁlesRecent changesIP editsDiscussionsCustomisationV · T · E
wikEd is a full-featured in-browser text editor forWikipedia edit pagesFrom Wikipedia, the free encyclopedia"WP:TOOLS" redirects here. For Toolforge, see Wikipedia:Toolforge. For the former Toolserver, seeWikipedia:Toolserver.For list of selected tools, see toolforge:admin/tools.See also: Category:Wikipedia tools and Optimum tool setTo search for tools, see Toolhub.Wikipedia programmingBots · Extensions · Gadgets · User scripts (List · Ranking · Requests · Guide · Otherscripts · Newsletter) · Tools
This page in a nutshell: Listed below are various tools intendedto simplify and increase efﬁciency of editing, and provideadditional functionality to Wikipedians.Browsing and editingSee also: Wikipedia:Browser notesEditing tools, tools intended to provide enhanced editing functionality. Contains edit pagetools, edit bots, spellcheckers, wikisyntax conversion utilities, etc.Browser tools, tools categorized by browser typeCitation tools, tools for citing and referencingAnti-vandalism tools, tools for patrolling and cleaning up WikipediaAlternative browsing, alternatives to accessing Wikipedia through your web browser(mobile devices, desktop integration, alternate portals, etc.)User scripts, a collection of JavaScript routines that add functionality to Wikipedia pages(e.g., regex search and replace, changing article formatting, and simplifying commontasks)WatchlistBot is a bot that delivers realtime alerts via instant message (XMPP) whenwatched articles are edited or when watched users or IP networks edit.Navigation shortcuts 


key: chroma:document
string_value:
that add functionality to Wikipedia pages(e.g., regex search and replace, changing article formatting, and simplifying commontasks)WatchlistBot is a bot that delivers realtime alerts via instant message (XMPP) whenwatched articles are edited or when watched users or IP networks edit.Navigation shortcuts offer the ability to add personal links to the sidebar, providing quickand easy access to favourite articles within Wikipedia.Finding duplicated references: a tool that will ﬁnd references with the same URL on apage, with some false positives and missed items, is the URL Extractor For Web Pagesand Text. It is not a Wikipedia tool, and there may be other tools available for thepurpose. Instructions on its use for Wikipedia are in WP:DUPREF. Such references canoften usefully be merged, using <ref name= xxx/> for all except one.SearchingSee also: Help:Searching § Custom search boxes, andCategory:Wikipedia search toolsGlobalWPSearch, search across projects and showmissing interlanguage links.macOS Dashboard Widget (deprecated)whichsub ﬁnds transcluded templates of a given pagewhich contain a given string.Find Link Tool Find links on Wikipedia. Tool created byEdward Betts.Wikimedia Global Search, perform Elasticsearch-basedsearches across the wikitext of all Wikimedia Foundation(WMF) wikis via WMCS Toolforge and Cloud Elastic services. Due to potential for abuse of expensive long-running queries (e.g., DoS attack), SUL login is required.Insource search is a handy tool that lets you ﬁnd speciﬁc terms or regex patterns across all Wikimedia wikis. Itgenerates a list of pages containing those terms, making it super useful for tasks like AWB/JWB and othersearch-related activities.Google toolsNote: Google search results can be several days or even weeks out of date.Citer for Google Books URL, DOI, ISBN, PMID, PMCID, OCLC converts bare url into {{cite book}} format. Seealso Help:Citation tools § Tools.Mirrors of Wikimedia content can be ﬁltered from Google search result pages in Firefox using theCustomizeGoogle extension.[1] See meta:Mirror ﬁlter for instructions and a ﬁlter list.Google Slidesmeta:User:Tbayer (WMF)/Converting Google Slides 


key: chroma:document
string_value:
converts bare url into {{cite book}} format. Seealso Help:Citation tools § Tools.Mirrors of Wikimedia content can be ﬁltered from Google search result pages in Firefox using theCustomizeGoogle extension.[1] See meta:Mirror ﬁlter for instructions and a ﬁlter list.Google Slidesmeta:User:Tbayer (WMF)/Converting Google Slides to wikitext (tutorial)Google Docsmeta:User:Tbayer (WMF)/Converting Google Docs to wikitext (tutorial + Python script)Verificationverify Flags text that is potentially incorrect or uncited by comparing the information in the article to the text ofits citations.Page historiesGeneralUser:Ixfd64/revision sizes, R program for visualizing revision sizes over timeWikipedia:Wiki2VCS, script that loads histories onto one's computer, so that they can be quickly diffed andsearchedXTools Page History Page statistics and visualization, provides sortable and exportable list of all contributorswith number of edits and amount of added text. Provides also results of syntax and grammar checks and latestassessment history.Finding the responsible userWikiBlame, searches for given text in versions of articlewhoCOLOR, browser script for Grease/Tampermonkey, highlights original authors directly in the article, getsdata from a publicly accessible APIXTools Blame, ﬁnd edits that added the given wikitextWho Wrote That?, browser extension for Chrome and Firefox, shows editor information for text as a user movesmouse over article text.User edit counts and analysisSee also: Category:Wikipedia contributor analysis toolsUser contribution search, ﬁnds all the edits by a user to a single pageEdit summary search, ﬁnd all the edits by a user such that their edit summary contains the speciﬁed stringWikipedia Page History Statistics Page history statistics by User:aka, builds an edit history overview pageXTools Pages Created – lists all pages created by a user (including deleted ones)afdstats Analyse AfD !votes against the resultArticles for Creation Review History. This tool shows a list of a user's WP:AfC reviews.User-level gender statistics for Wikipedia : gender statistics about the list of created articles.Look at your list of created articles through Wikidata.Look at your list of created articles 


key: chroma:document
string_value:
for Creation Review History. This tool shows a list of a user's WP:AfC reviews.User-level gender statistics for Wikipedia : gender statistics about the list of created articles.Look at your list of created articles through Wikidata.Look at your list of created articles with the Xtools Page Prose APIMap your list of created articles through Wikidata.Wiki streaks, look up a user's edit streak: how many consecutive days they've made an editEdit countersSee also: Wikipedia:WikiProject edit countersXTools Edit Counter A powerful and full-featured editor analysis tool.Administrator Statistics for the English Wikipedia (updated daily)User contributions (Luxo), ﬁnd contributions on enwiki and other Wikimedia sitesXTools AdminStats Shows statistics of admin actions, broken down into individual actions, arbitrary periodselectableUser interaction analysisSee also: Wikipedia:Tools/User interaction investigationsEditor Interaction Analyzer compares the edits of two to three speciﬁed editors to see which articles overlap,sorted by minimum time between edits by both users. Only works on the English Wikipedia. Speed: slow.Intersect Contribs, compares the edits of two to eight editors at any WMF wiki to see which articles overlap.Speed: fast.Intertwined contributions, merges the contributions of two editors at any WMF wiki into a single list. Speed: fast.(Currently not working: error connecting to database.)Interaction Timeline a chronological history of two users' across pages where they both made edits.VisualizationWiki Replay, see m:Grants:IEG/Replay Edits and wm2014:Submissions/Replay Edits for more details.de:Benutzer:Atlasowa/edit history visualizationImporting (converting) content to Wikipedia (MediaWiki) formatSee also: Wikipedia:How to import articles, commons:Commons:Chart and graph resources,Wikipedia:Tools/Editing tools § Wikisyntax conversion utilities, and Help:Table § Converting spreadsheets anddatabase tables to wikitable formatGoogle Docs SpreadsheetMediaWiki Table Utility or this updated version This class constructs a MediaWiki-format table from anExcel/GoogleDoc copy&paste. It provides a variety of methods to modify the style. It defaults to a Wikipediastyling with ﬁrst column header.[2]Microsoft OfﬁceWord2007 and laterMicrosoft Ofﬁce Word Add‑in For MediaWiki. For Microsoft Word 2007 or 2010. (Not Supported from VersionWord 


key: chroma:document
string_value:
from anExcel/GoogleDoc copy&paste. It provides a variety of methods to modify the style. It defaults to a Wikipediastyling with ﬁrst column header.[2]Microsoft OfﬁceWord2007 and laterMicrosoft Ofﬁce Word Add‑in For MediaWiki. For Microsoft Word 2007 or 2010. (Not Supported from VersionWord 2013)Prior versionsFor other Macros, see mw:Word macros, Visual Basic macros to use within Microsoft Word to prepare content tobe pasted into a Wikipedia page.wikEd, a full-featured in-browser text editor for Wikipedia edit pages that can convert text and tables pasted fromMicrosoft Word with a button clickExcelexcel2wiki: Copy & Paste Excel-to-Wiki Convertertab2wiki: Converts tables (tab-delimited, e.g. copied from Excel) to Wikitext tablesde:Wikipedia:Technik/Text/Basic/EXCEL-Tabellenumwandlung/en: Convert EXCEL-Table with most formattinglike background- and fontcolor, fontstyle (bold/italic), columnheight, -width, etc. to Wiki-tableformatde:Benutzer:Duesentrieb/csv2wp (en) or CSV Converter: Converts many types of spreadsheet tables, includingCSV, tab-separated, etc., to MediaWiki or HTMLcsv2other: a free open source tool, in .net, to convert CSV and EXCEL ﬁles to wiki table formatOpenOfﬁce/LibreOfﬁceLibreOfﬁce Writer is free. It can open almost any ﬁle format. It can export to Mediawiki: File menu > export >save as type > MediaWiki. It will save the ﬁle as a .txt ﬁle which can be opened with any text editor. Copy thewiki code from the text ﬁle. You can save any web page as an HTML ﬁle, and then open it in LibreOfﬁce Writer.Edit as needed. Remove the parts you don't want. Keep only tables for example. Then export to MediaWiki.Tables can be further edited in LibreOfﬁce Calc. See: Commons:Convert tables and charts to wiki code or imageﬁles. And: Help:Table and the section on spreadsheets and the Visual Editor.HTMLHtml2Wiki is an extension for MediaWiki that imports HTMLPythonTable2wiki.py part of the Pywikipedia bot framework, web portLaTeXUser:Jmath666/latex2wiki, LaTeX to Wikicode translation toolCSVCSVLoader is an AutoWikiBrowser plug-in that allows creating and updating articles using CSV data ﬁles.Many formatsPandoc is a universal document 


key: chroma:document
string_value:
is an extension for MediaWiki that imports HTMLPythonTable2wiki.py part of the Pywikipedia bot framework, web portLaTeXUser:Jmath666/latex2wiki, LaTeX to Wikicode translation toolCSVCSVLoader is an AutoWikiBrowser plug-in that allows creating and updating articles using CSV data ﬁles.Many formatsPandoc is a universal document converterExport: Conversion to other formatsHelp:Export, Special:Export – XMLSpecial:Book – PDFmw:Alternative parsers – various, including HTML and XMLwikitable2csv – CSVmw:Extension:TextExtracts – HTML or plain text; without linksmeta:User:Tbayer (WMF)/Converting wiki pages to plaintext emails – textMediaWiki to LaTeX – PDF, EPub, Odt or LaTeXWiki Embed Plugin – WordPressGeotagging-related toolsSee also: Wikipedia:Obtaining geographic coordinatesGeoLocator, Wikipedia compatible geotagging metadata generator and coordinate editorGadget developersTools for gadget devs:Wikiblame – use for searching when some function or option was introduced.Wiki-to-Git – download JS/CSS history to Git which you can then use for gadget development as well as use gitblame and other standard development tools.Wikiploy – use to deploy gadgets to Wikipedia, Meta and other MediaWiki sites.Global Search – use to check global usage of gadgets, functions etc.Browser tools:Firefox DevTools User Docs – JS debugger, CSS editor etc...Chrome DevTools.OtherSyndication, RSS feeds, etc.Researching Wikipedia: Tools for data analysisNot English, tools that have not yet been translated completely into English. Some need their descriptionstranslated from German, others are not available in English. Help translate if you can!Note: Checkinks is buggy use with caution. Consider using instead Internet Archive Bot which can be foundin the History tab of any page: "Fix dead links" – login does not require a password.WikiBiff, To alert users when they have new messages waiting on their talk pagesDesktop Watchlist, Enhanced watchlist for WindowsCategory Watchlist, Watching additions and removals to categoriesCategoryWatchlistBot, Watch category and/or template additions/removals, supports partial name matches andsubcategoriesPetScan (manual), searches categories recursively. Will ﬁnd subcategories that overlap with othercategories, templates, etc.User:SuggestBot for suggested articles you might like to editRAMP editor: can generate enhanced 


key: chroma:document
string_value:
additions and removals to categoriesCategoryWatchlistBot, Watch category and/or template additions/removals, supports partial name matches andsubcategoriesPetScan (manual), searches categories recursively. Will ﬁnd subcategories that overlap with othercategories, templates, etc.User:SuggestBot for suggested articles you might like to editRAMP editor: can generate enhanced authority records for creators of archival collectionsXEcho Shows your global cross-wiki notiﬁcations from 800+ wikis at a glancequarry:, a place to run queries on databases of Wikimedia projectsMTC!, A tool that makes it easy to transfer ﬁles to Commons en masse.Wiki Editor Plugin for Notepad++ 32-bit (x86) – a free source code editor.MediaWiker Plugin for Sublime Text. MediaWiki syntax highlighting and editing capabilities.MediaWiki Tables Generator (online)Wikipedia:Get my IP addressSee alsoWikipedia:Database download (for code useful for dealing with ofﬂine dumps)Wikipedia:ScriptsWikipedia:Tools/Optimum tool set (Firefox optimization)Wikipedia:Cleaning up vandalism/ToolsWikipedia:Link rot § ToolsWikipedia:WikiProject User scripts/Scripts § Installing (How to install user scripts)Help:Text editor support{{Editor tools}}meta:Help:User styleToolforgemeta:Toolserver/Projectsmeta:Open Source Toolsetmeta:User:Duesentrieb/ToolsCommons:Convert tables and charts to wiki code or image ﬁlesReferences1. ^ CustomizeGoogle2. ^ Enhanced Spreadsheet to WikiMedia table Converter proposedWikipedia directories and indexesWikipedia editor navigation - (Search)Category: Wikipedia tools
Search
Search Wikipedia
DonateCreate accountLog in


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\WPP_8.2_Klinger_DataAccess-DSA.pdf


key: chroma:document
string_value:
OCTOBER 2023 Weizenbaum Institut e for the Networked Society What the Scientific Community Needs from Data Access under Art. 40 DSA 20 Points on Infrastructures, Participation, Transparency, and Funding 1 Imprint What the Scientific Community Needs from Data Access under Art. 40 DSA . 20 Points on Infrastructures, Participation, Transparency, and Funding , Weizenbaum Policy Pap er 8, October 2023 AUTHORS: Ulrike Klinger \ European University Viadrina \ klinger@europa -uni.de Jakob Ohme \ Weizenbaum Institut e \ jakob.ohme@weizenbaum -institut.de PUBLISHER : Weizenbaum Institut e for the Networked Society Hardenbergstraße 32 \ 10623 Berlin \ Tel.: +49 30 700141 -001 info@weizenbaum -institut.de \ www.weizenbaum -institut.de EDITORIAL TEAM: Moritz Buchner \ Weizenbaum Institut e Christina Dinar \ Leibniz-Institut für Medienforschung | HBI Robert Peter \ Weizenbaum Institut e Kaltrina Shala \ Weizenbaum Institut e DOI: 10.34669/WI.WPP/ 8.2 ISSN: 2940-8490 LICENSE: This paper is available open access and is licensed under Creative Commons Attribution 4.0 (CC BY 4.0): https://creativecommons.org/licenses/by/4.0/ For inquiries regarding this paper please contact Robert Peter at: robert.peter@weizenbaum -institut.de This policy paper has been funded by the Stiftung Mercator. The Weizenbaum -Institut e.V. adheres to the Code of Conduct of the EU Transparency Register, register ID 194885445254 -71. The Weizenbaum Institute is funded by the Federal Ministry of Education and Research of Germany (BMBF) . 2 About the Weizenbaum Institut e The Weizenbaum Institute – The German Internet Institute analyzes, evaluates and shapes relevant aspects of the digitally networked society. With basic, interdisciplinary and prob-
lem-oriented research projects on the ethical, legal, economic, political and social dimen-
sions of digi tal change and the exploration of concrete solutions, it provides politicians, business and civil society with evidence - and value -based options for action in order to shape digitalization in a sustainable , self -determined and responsible manner. The Insti-
tute is supported by 


key: chroma:document
string_value:
the exploration of concrete solutions, it provides politicians, business and civil society with evidence - and value -based options for action in order to shape digitalization in a sustainable , self -determined and responsible manner. The Insti-
tute is supported by a research network from Berlin and Brandenburg, which includes Freie Universität Berlin, Humboldt -Universität zu Berlin, Technische Universität Berlin, Berlin University of the Arts, and the University of Potsdam, as well as the Fraunh ofer Institute for Open Communication Systems (FOKUS) and the WZB Berlin Social Science Center. The Weizenbaum Institute is funded by the German Federal Ministry of Educa-
tion and Research (BMBF) and the State of Berlin. For more information, visit www.weizenbaum -institut.de . About the author s Ulrike Klinger is Professor for Digital Democracy at the European New School of Dig -
ital Studies, European University Viadrina, Frankfu rt (Oder). Contact: klinger@europa -uni.de Jakob Ohme is Research Group Lead of the “Digital News Dynamics” group at the Weizenbaum Institute for the Networked Society, Berlin. Contact: jakob.ohme@weizenbaum -institut.de About th is paper The paper underwent an iterative development process stemming from two workshops held in March and June 2023. These workshops were organized by the authors and sup-
ported by Stiftung Mercator. Approximately 70 scientists and platform researchers from various fields actively contributed to the paper ’s development. Concurrently, informal discussions occurr ed with scientists hailing from different European Union nations, as well as regulatory authorities in Germany. In response to the EU Commission ’s Call for Evidence issued in May 2023, the authors submitted an interim status report , see Klinger & Ohme (202 3). Delegated Regulation on Data Access Provided for the Digital Services Act: Response to the Call for Evidence DG CNECT -CNECT F2 by the European Com-
mission . https://doi.org/10.34669/WI.WPP/7 3 What the Scientific Commu nity Needs from 


key: chroma:document
string_value:
Klinger & Ohme (202 3). Delegated Regulation on Data Access Provided for the Digital Services Act: Response to the Call for Evidence DG CNECT -CNECT F2 by the European Com-
mission . https://doi.org/10.34669/WI.WPP/7 3 What the Scientific Commu nity Needs from Data Access under Art. 40 DSA 20 Points on Infrastructures, Participation, Transparency, and Funding1 To ensure free and objective research on social media platforms and their impact on systemic risks to the economy and society, reliable and independent access to platform data with high data quality is essential. Article 40 of the Digital Services Act (DSA) creates for the first time a clear regulation that grants science independence fro m individual platforms and improved data quality , thus ensuring that socially relevant aspects of digitization can be investigated appropri-
ately, consistently , and independently . It makes it possible to respond more quickly and accurately to new issues and developments in an evidence -based manner, thus contrib-
uting to a fair, digital public sphere that considers societal risks and opportunities . This policy paper aims to inform the expected Delegated Act of the EU Commission2 as well as the legislative pr ocess for the German Digital Services Act (Digitale Dienste Ge-
setz) and to formulate necessities from the perspective of platform researchers. This per-
spective is of utmost importance, as research on systemic risks depends on the expertise of scientific ac tors. In the implementation and further legislative process at national and European level, the following 20 points are particularly important from a scientific per-
spective: Who should have access ? 1. Enable equal access for platform researchers : Research on digitization and its im-
pacts has been characterized by unequal access to resources and data. The goal must be to grant all platform researchers (if accredited) equal access to data. This will lead to greater 


key: chroma:document
string_value:
for platform researchers : Research on digitization and its im-
pacts has been characterized by unequal access to resources and data. The goal must be to grant all platform researchers (if accredited) equal access to data. This will lead to greater diversity and independence in research. One-stop shops and research data centers can support this. __________________________________________________________________ _____ 1 We acknowledge the work of the contributors who helped shaping this paper with their valuable inputs and com-
ments: Alexander Wehde, Andrea Lorenz, Daniela Stockma nn, Erik Tuchtfeld , Johannes Breuer, Judith Möller, Julia Niemann -Lenz, Katharina Kaesling , Katharina Kleinen -von Königslöw, Katrin Weller, Marie -Therese Sekwenz, Mario Haim, Matthias C. Kettemann, Matthias Spielkamp, Mia Berg, Michael Meyer -Resende, Phili pp Darius, Philipp Lorenz -Spreen, Pia Sombetzki, Richard Kuchta, Simon Munzert, Sonja Schimmler, Valerie Hase . 2 Cf. the detailed proposals on data access in Klinger & Ohme (2023). Delegated Regulation on Data Access Pro-
vided for the Digital Services Act: Response to the Call for Evidence DG CNECT -CNECT F2 by the European Com-
mission. https://doi.org/10.34669/WI.WPP/7 4 2. Allow access to non -EU researchers and journalists : The DSA must not lead to the compartmentalization of European science. Therefore, access for non -European re-
searchers in cooperation with European resear chers must be possible. The access cri-
teria described in Art. 40 para. 8 lit. b DSA should be interpreted broadly for access according to DSA 40 para. 12 for journalists who act in the sense of public education and information. How can fair access w ork? 3. Access must be free of charge and independent : The current monetary exploitation of X’s (formerly known as Twitter) API access clearly shows how important free access is for making research egalitarian and diverse. The DSA clearly puts the onus on the platforms to provide data access for 


key: chroma:document
string_value:
: The current monetary exploitation of X’s (formerly known as Twitter) API access clearly shows how important free access is for making research egalitarian and diverse. The DSA clearly puts the onus on the platforms to provide data access for science; the platforms should also bear the costs for this. 4. Comprehensive data access for accredited researchers : The following infor-
mation should be available for vetted researchers as defined in Art. 40 para. 4, 8 DSA: • Information on data structures, sample (representativeness), and available platform data, e.g., as a list of variables, collected metadata, and operation-
alizations at data access • Information about recent or soon -planned changes to the data structures and the available data • Information about the exact processing, aggregation, and anonymization of the raw data • Data that includes internal weighting of data features for algorithmic sort-
ing/select ion and other internal decisions such as A/B testing or new plat-
form functionality • Platform -specific, publicly accessible data in machine -readable form, in real-time and historically, and available at any time • Platform -specific, personal data in machine -readable form, historically, only after a successful vetting process of researchers and, if applicable, consent of the users (for personal, non -public data) • Cross -platform data prepared in a standardized, machine -readable form 5 5. Custom -fit access modes3: Access to historical and real -time data (steaming APIs) should be as complete as possible via data interfaces (APIs) provided free of charge. Different levels of data sensitivity4 should offer differently formulated accesses and procedures5. At high sens itivity levels in so -called data clean rooms6, lower level in virtual laboratory environments (VLEs)7. Other possibilities for access modes are closed collections, ad libraries, or data donations, which can also be integrated via APIs or other interfaces , for example. For 


key: chroma:document
string_value:
in so -called data clean rooms6, lower level in virtual laboratory environments (VLEs)7. Other possibilities for access modes are closed collections, ad libraries, or data donations, which can also be integrated via APIs or other interfaces , for example. For experimental studies and algorithmic au-
dits, it should be possible to set up so -called sock puppets (i.e., online identities ex-
plicitly created for research purposes). 6. Flexible access design : Art. 40 para. 8 DSA so far only provides for individual ac-
cess, i.e., by individual researchers. However, the application procedure should be more flexible. An institutional anchoring with a longer term and the possibility of adding new team members would be optimal. Data access should also be usable for academic teaching as well as early -career researchers who ensure the future of plat-
form research. A digital self -disclosure of the research project's independence from commercial interests (DSA 40. para. 8, b) and funding of the research project (DSA 40. para. 8, c) should be sufficient for the approval process under DSA 40. para. 12. Conditions DSA 40. para. 8, d) (data security and confidentiality requirements) and e) (access necessary and proportionate) disproportionately restrict access, as this co n-
cerns publicly accessible data. It must be clarified to what extent or how collected data can be shared (e.g., for replication studies) or reused (e.g., in consortia ). How should the approval process be designed? 7. Conduct of the approval process preferably by the local Digital Services Coordi-
nator (DSC) : the approval process should be conducted in a timely manner (within 7 days), ideally by (or in close coordination with) the DSC of the applicant's home country, to allow for relief of busy DSCs (l ikely in Ireland). An appeal mechanism to this process should be offered through an independent advisory board attached to 


key: chroma:document
string_value:
by (or in close coordination with) the DSC of the applicant's home country, to allow for relief of busy DSCs (l ikely in Ireland). An appeal mechanism to this process should be offered through an independent advisory board attached to the local DSC (see draft bill for the German Digitale Dienste Gesetz, para. 22), due to greater knowledge of national institutions an d processes. __________________________________________________________________ _____ 3 See note 1. 4 See recital 51 GDPR https://eur -lex.europa.eu/legal -
content/DE/TXT/PDF/?uri=CELEX:32016R0679&qid=1694877783373 5 See the Hertie School Data Science Lab ’s detailed proposal, Implementing Data Acess of the DSA, https://hertie-
school -f4e6.kxcdn.com/fileadmin/2_Research/2_Research_directory/Research_Centres/Centre_for_Digital_Govern-
ance/5_Papers/Implementing_Data_Access_Darius_Stockmann_2023.pdf , last ac cessed 04/24/2023. 6 Data clean rooms are safe, secure environments where personally identifiable information (PII) is cleaned and pro-
cessed so that it can be made available for a variety of data analysis purposes. 7 The virtual laboratory environment is a n interactive environment for creating and performing simulated experiments and analyses. 6 8. Distinguishing data sensitivity for access requests : In the approval process, a dis-
tinction should be made between access to medium - and highly -sensitive data as de-
fined in Art. 40 para. 4 DSA and prioritized access to publicly available data as de-
fined in Art. 40 para. 12 DSA. 9. Prioritize publicly available data : Publicly accessible data from the platforms must be made available at all times and without a vetting process, according to Art. 40 (12) DSA. This refers to data not restricted by the user and can be viewed by freely brows-
ing the platform. Technically, t his means, above all, the provision of real -time access through APIs (data interfaces) and dashboards. A definition of semi -public data is needed, e.g., “private ” Facebook or Telegram groups with thousands of members. Art. 40(12) DSA should be implemented as a priority (also concerning upcoming EU and 


key: chroma:document
string_value:
access through APIs (data interfaces) and dashboards. A definition of semi -public data is needed, e.g., “private ” Facebook or Telegram groups with thousands of members. Art. 40(12) DSA should be implemented as a priority (also concerning upcoming EU and US elections) and will already cover a large part of scientific data needs. This requires early, clear guidance from the EU Commission on the implementation of Art. 40(12). 10. Low -threshold, modular application procedure : For simplification and standardi-
zation, we propose a modular principle in which data and usage interests, as well as data protection measured, are queried in a standardized manner. Users should only need to specify general research interests, si milar to the former Twitter Academic API, and also allow exploratory research. Information about what specific data/vari-
ables are available should be easily accessible. In addition to German, the application should be available at least in English to enabl e inclusive data access. Access should be granted via login to an online tool where data from multiple platforms can be ac-
cessed simultaneously, also to ensure much -needed cross -platform research on sys-
temic risks. 11. Expand infrastructures and resources, bu ild competence through close ex-
change : Uniform and clear infrastructure requirements must be formulated for re-
search institutions so that appropriate preparations can be initiated, such as a secure server infrastructure. There should be contact persons for questions and support in access for those who do not have the necessary technical skills. There is a need for targeted research funding programs at the European and national levels that explore systemic risks based on requested platform data. These highly specialized and re-
source -intensive projects cannot be carried out under existing funding programs. 12. Involvement of the scientific community in peer review processes : Applications that have already been submitted in this way 


key: chroma:document
string_value:
based on requested platform data. These highly specialized and re-
source -intensive projects cannot be carried out under existing funding programs. 12. Involvement of the scientific community in peer review processes : Applications that have already been submitted in this way in a similar form should be rev iewed primarily for formalities, ethics, and feasibility of data sharing before direct, timely approval is given. Applications for which there is no precedent should be reviewed more comprehensively, in terms of content, in a peer review system (and may al so be reviewed only formally in the future). This reduces review cases and resources. Ade-
quate compensation for researchers involved in the peer review process should be guaranteed. 7 How can data quality be safeguarded? 13. Advisory board structure for the DSC : The planned, independent advisory board of the German DSC should advise on overarching strategic issues with regard to the implementation of the DSA and allow the inclusion of scientific issues. In order to fulfill these tasks, researchers who can demonst rate expertise in the field of empirical research with platform data should be represented on the advisory board. Duplicate structures with a planned Intermediary Advisory Mechanism according to Art. 40(13) DSA should be avoided. 14. Conditions for the quality of data preparation : The preparation of the data should be the main responsibility of the platforms and the form of preparation should meet uniform standards in order to meet the listed requirements. The catalog of interfaces and data points should not be defined unilaterally by the platforms but should be de-
termined in a standardized manner through a process independent of the platforms and involving the researchers (e.g., independent advisory mechanism (IAM) to sup-
port data sharing under Art. 40(13) DSA) . Standardization is necessary to ensure that platform -comparative and cross -platform 


key: chroma:document
string_value:
in a standardized manner through a process independent of the platforms and involving the researchers (e.g., independent advisory mechanism (IAM) to sup-
port data sharing under Art. 40(13) DSA) . Standardization is necessary to ensure that platform -comparative and cross -platform studies are methodologically valid8. This also applies to the provision of text, image/video and audio to enable platform com-
parisons. Direct forwarding of research questions to the platforms should be prevented to exclude any influence on the part of the platforms. 15. Documentation and trans parency of variables, measurements, and data collec-
tion: Information about when collected data and measurements from platforms were changed over time should be retrievable. Research needs more transparency about metrics, e.g., what does a “like” or “views” mean on different platforms? As uniform as possible variable naming and metadata structure should be strived for – also for “public” data (Art. 40(12) DSA) - here the opportunity for cross -platform simplifica-
tion and harmonization of indicators exists. 16. Right to scraping for scientific quality assurance : Indispensable for scientifically sound quality control of data is the “right to scrap ”. Without the right to scrap, the data access offered by platforms cannot be validated. Incomplete data sets, such as those repeatedly provided by platforms in the past (e.g., the Facebook Ad Archive), are hardly useful for research and, in the worst case, are harmful because they falsify the results. Data donations by users are also essential for research and quality contro l. The possibilities for this should be expanded and simplified . __________________________________________________________________ _____ 8 Cf. also item 1 in https://algorithmwatch.org/en/wp -content/uploads/20 23/05/Open_letter_DSA.pdf 8 17. Platform data quality reports : Platforms should publish regular reports that include aspects of the data quality provided (e.g., validation by external bodies, own data cleansing initiatives , completeness of data, etc.). 18. Insight 


key: chroma:document
string_value:
in https://algorithmwatch.org/en/wp -content/uploads/20 23/05/Open_letter_DSA.pdf 8 17. Platform data quality reports : Platforms should publish regular reports that include aspects of the data quality provided (e.g., validation by external bodies, own data cleansing initiatives , completeness of data, etc.). 18. Insight into the platform data pool for research purposes, including non -Euro-
pean : Art. 40 para. 4 DSA is intended to provide access to the entire platform data pool, as systemic risks can only be identified if there is clari ty about the totality of all data available to the platforms. Viewing and pre -structuring of existing platform data should be done centrally by the DSCs. Non -European platform data must be accessi-
ble, e.g., in the context of manipulated social media data a nd disinformation. The market location principle ( lex loci solutionis ) must be applied here .9 19. Oversight : An authority must be appointed that can independently check the quality of the data preparation (possibly an Intermediary Advisory Mechanism, which would have to be provided with extra resources for this purpose, cf. Klinger & Ohme). Highly qualified data scientists are needed to assess the data provided by the platforms in terms of quality and potential uses, who can provide a profes sional assessment, including on the open question of what the data queries of approved researchers may even contain in terms of societal risks. In the event of poor data quality, a short -term and transparent (complaint) procedure should be available for re adjustment; in case of doubt, fine procedures should also be able to follow. 20. Serious penalty mechanisms are good, but incentive structures are better : Delib-
erate delays in data access by a platform should result in penalty proceedings. How-
ever, we recomme nd not only to work with serious sanction mechanisms, but also to create incentives 


key: chroma:document
string_value:
penalty mechanisms are good, but incentive structures are better : Delib-
erate delays in data access by a platform should result in penalty proceedings. How-
ever, we recomme nd not only to work with serious sanction mechanisms, but also to create incentives for platforms in the medium term by providing sufficient resources for data access (e.g., special compliance). If the platforms refuse to grant access, re-
search institution s should be able to proceed by means of an action for failure to act or a refusal counterclaim, so that mechanisms and corresponding resources should also be provided for this. __________________________________________________________________ _____ 9 Since the scope of the DSA applies according to the market location principle (regardless of the platform ’s place of establishment), non -European data from non -European platforms are also included, as long as these platforms offer services in the EU or to EU citizens. 9 Signatories (institutions) Weizenbaum Institut e for the Networked Society , Berlin European New School, Europa -Univers ität Viadrina, Frankfurt (Oder) AlgorithmWatch Center for Advanced Internet Studies (CAIS) D64 – Zentrum für Digitalen Fortschritt Democracy Reporting International (DRI) GESIS Leibniz -Institut für Sozialwissenschaften e.V. Stiftung Neue Verantwortung (SNV) Signatories (individuals ) Ulrike Klinger – Professorin, European New School, Europa -Universität Viadrina , Frankfurt (Oder ) Jakob Ohme – Head of Research Group, Weizenbaum Institute , Berlin Alexander Wehde – Student Assistant, Forschungsstelle für Rechtsfragen neuer Technologien sowie Datenrecht (ForTech) e.V. Andrea Lorenz – Research Associate, Universität Hamburg Christoph Neuberger – Scientific Managing Director , Weizenbaum Institute , Berlin; Professor, Freie Universität Berlin Daniela Stockmann – Professor, Center for Digital Governance, Hertie School, Berlin 10 Erik Tuchtfeld – Research Associate , Max-Planck -Institut für ausländisches öffentliches Recht und Völkerrecht, Heidelberg Jan-Hendrik Passoth – Professor, European New School, Europa -Viadrina Universität Frankfurt (Oder ) Johannes Breuer – Senior 


key: chroma:document
string_value:
Center for Digital Governance, Hertie School, Berlin 10 Erik Tuchtfeld – Research Associate , Max-Planck -Institut für ausländisches öffentliches Recht und Völkerrecht, Heidelberg Jan-Hendrik Passoth – Professor, European New School, Europa -Viadrina Universität Frankfurt (Oder ) Johannes Breuer – Senior Researcher, GESIS Leibniz -Institut für Sozialwissenschaften & Center for Advanced Internet Studies (CAIS) Judith Möller – Professor, Leibniz -Institut für Medienforschung | Hans -Bredow -
Institut, Universität Hamburg Julia Niemann -Lenz – Senior Research Associate, Universität Hamburg Katharina Kaesling – JProfessor, Technische Universität Dresden Katharina Kleinen -von Königslöw – Professor, Universität Hamburg Katrin Weller – Senior Researcher, GESIS Leibniz -Institut für Sozialwissenscha ften Marie -Therese Sekwenz – PhD Candidate , TU Delft/ Technology Policy and Management/ AI Futures Lab Mario Haim – Professor, Ludwig -Maximilians -Universität, München Matthias C. Kettemann – Professor, Universität Innsbruck, Alexander von Humboldt -
Institut für Internet und Gesellschaft, Leibniz -Institut für Medienforschung | Hans -
Bredow -Institut Matthias Spielkamp – Co-founder and Executive Director, AlgorithmWatch Mia Berg – Research Associate, Ruhr -Universität Bochum Michael Meyer -Resende – Co-founder & Executive Director, Democracy Reporting International (CRI), Berlin Philipp Darius – Postdoctoral Researcher, Center for Digital Governance, Hertie School , Berlin Philipp Lorenz -Spreen – Research Scientist, Max Planck Institut e for Human Developmen t, Berlin Pia Sombetzki – Policy & Advocacy Manager, AlgorithmWatch 11 Richard Kuchta – Analyst and Researcher, Democracy Reporting International Simon Munzert – Professor, Data Science Lab, Hertie School, Berlin Sonja Schimmler – Head of Research Group, Weizenbaum Institute , Berlin Valerie Hase – Postdoctoral Researcher, Ludwig -Maximilians -Universität , München


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\WPP_9_2024_Enabling-Research-with-Publicly-Accessible-Platform-Data-2.pdf


key: chroma:document
string_value:
APRIL 2024 Weizenbaum Institut e Enabling Research with Publicly Accessible Platform Data: Early DSA Compliance Is-
sues and Suggestions for Improvement Position paper 1 Imprint Enabling Research with Publicly Accessible Platform Data: Early DSA Compliance Issues and Suggestions for Improvement , Weizenbaum Policy Paper 9, April 2024 AUTHORS: Julian Jaursch \ Stiftung Neue Verantwortung \ jjaursch@stiftung -nv.de Jakob Ohme \ Weizenbaum Institute \ jakob.ohme@weizenbaum -institut.de Ulrike Klinger \ European University Viadrina \ klinger@europa -uni.de PUBLISHER : Weizenbaum Institut e Hardenbergstraße 32 \ 10623 Berlin \ Tel.: +49 30 700141 -001 info@weizenbaum -institut.de \ www.weizenbaum -institut.de EDITORIAL TEAM: Moritz Buchner \ Weizenbaum Institute Elja Krützfeld \ Weizenbaum Institute DOI: 10.34669/WI.WPP/ 9 ISSN: 2940-8490 LICENSE: This paper is available open access and is licensed under Creative Commons Attribution 4.0 (CC BY 4.0): https://creativecommons.org/licenses/by/4.0/ The Weizenbaum -Institut e.V. adheres to the Code of Conduct of the EU Transparency Register, register ID 194885445254 -71. The Weizenbaum Institute is funded by the Federal Ministry of Education and Research of Germany (BMBF) . 2 About the Weizenbaum Institut e The Weizenbaum Institute analyzes, evaluates and shapes relevant aspects of the digitally networked society. With basic, interdisciplinary and problem -oriented research projects on the ethical, legal, economic, political and social dimensions of digital change and the exploration of concrete solutions, it provides politicians, business and civil society with evidence - and value -based options for action in order to shape digitalization in a sustain-
able, self -determined and responsible manner. The Institute is supported by a research network from Berlin and Brandenburg, which includes Freie Universität Berlin, Hum-
boldt -Universität zu Berlin, Technische Universität Berlin, Berlin University of the Arts, and the University of Potsdam, as well as the Fraunhofer Institute for O pen Communica-
tion Systems (FOKUS) and the WZB Berlin Social Science Center. The Weizenbaum Institute is funded by 


key: chroma:document
string_value:
zu Berlin, Technische Universität Berlin, Berlin University of the Arts, and the University of Potsdam, as well as the Fraunhofer Institute for O pen Communica-
tion Systems (FOKUS) and the WZB Berlin Social Science Center. The Weizenbaum Institute is funded by the German Federal Ministry of Education and Research (BMBF) and the State of Berlin. For more information, visit www.weizenbaum -institut.de . About the authors Julian Jaursch is project director, “Policy | Platform regulation” at Stiftung Neue Verantwortung, Berlin. Contact: jjaursch@stiftung -nv.de Jakob Ohme is Research Group Lead of the “Digital News Dynamics” group at the Weizenbaum Institute for the Networked Society, Berlin. Contact: jakob.ohme@weizenbaum -institut.de Ulrike Klinger is Professor for Digital Democracy at the European New School of Digital Studies, European University Viadrina, Frankfurt (Oder). Contact: klinger@europa -uni.de 3 Enabling Research with Publicly Accessible Platform Data: Early DSA Compliance Issues and Suggestions for Improvement Position paper The EU’s Digital Services Act (DSA) requires very large online platforms and search engines (VLOPs) to provide publicly accessible data to researchers meeting certain re-
quirements (Article 40(12) ). While some platforms have taken laudable steps to imple-
ment such data access opportunities, serious concerns remain about full compliance with the DSA in this regard. This is reflected in the European Commission’s effort to request information from 17 VLOPs on how they comply with Article 40(12). Currently, researchers from academia and civil society still face significant hurdles when trying to request publicly accessible data from VLOPs. To provide the Commission and Digital Services Coordinators with insights for their oversight work, this paper offers an analysis of early experiences with Article 40(12) data access requests and suggestions for improvement. It is based on conversations with researchers and on data collected through the DSA 40 Data Access Tracker . Compiled by Julian Jaursch (Stiftung Neue Verantwortung), Jakob Ohme 


key: chroma:document
string_value:
early experiences with Article 40(12) data access requests and suggestions for improvement. It is based on conversations with researchers and on data collected through the DSA 40 Data Access Tracker . Compiled by Julian Jaursch (Stiftung Neue Verantwortung), Jakob Ohme (Weizenbaum Institute) and Ulrike Klinger (Europa Universität Viadrina). 1. Application forms Status quo: Application forms are often hard to find and unclear. Currently, forms to apply for platform data access under Article 40(12) can be hard to find on platform websites and often come in a format hosted by third -party platforms (such as Google). For example, a link to X’s DSA data access application is linked in a “snippet” banner at the very bottom of a single page on their website. However, the sub-
pages, including the subpage specifically for academic researchers, do not include the form or any information about the program. They also provide little informatio n on the desired length and detail of responses. These aspects impede researcher access and trust in the data processing of application data . 4 Suggestion: Application forms need to be easy to find, accessible, and secure. Given that application data contain information about research projects and institutions (such as technical -operational measures), more official access to application forms and hosting is necessary across all VLOPs. Platforms should offer a website informing re-
searchers about possibilities of data access and provide professional, standardized appli-
cation forms and information on how platforms handle data from access requests. Re-
searchers should be g iven a timeline of when they can expect to have their reque sts dealt with. Additional support could come from academic and other organizations that provide a collection of access points. 2. Eligibility criteria Status quo: Eligibility criteria are interpreted too strictly. The DSA does not narrow the eligibility criteria for Article 40(12) applications 


key: chroma:document
string_value:
with. Additional support could come from academic and other organizations that provide a collection of access points. 2. Eligibility criteria Status quo: Eligibility criteria are interpreted too strictly. The DSA does not narrow the eligibility criteria for Article 40(12) applications to only universities or other academic institutions. On the contrary, the wording on eligible re-
searchers is rather broad, with Article 40(12) particularly mentioning not -for-profit or-
ganizations. However, at some VLOPs, requesting data can be difficult or impossible for researchers who are not affiliated with “traditional” academic institutions such as uni-
versities. For instance, TikTok’s Research API and the YouTube Researcher Program state that researchers must be affiliated with an eligible “academic institution”. Even if this is not explicitly mentioned, requirements such as naming a “principal investigator” can be exclusionary since such structures are uncommon outside of universities. Applicants, particularly those from not -for-profit organizations and other non -academic institutions, also face hurdles in applying for these programs because they are struc-
tured to grant access on an individual project basis rather than an organizational basis . Not -for-profit researchers frequently design more general social media monitoring operations as the starting point for in -depth investigations. Under the current project -
based design of many data access programs, researchers would need to reapply fo r access precisely at each point when uninterrupted data access becomes critical, even for research that is related or similar to the original purpose under which they applied for access. Suggestion: Applications should be open to eligible non -academic researchers. Various VLOPs do explicitly gear their application forms towards non -governmental organizations . This approach should be followed by all VLOPs, for example, by allow-
ing a self -identification of researchers’ affiliations in the application form and by not dis-
regarding applications from non -academic institutions and journalists. Researchers from outsi de 


key: chroma:document
string_value:
-governmental organizations . This approach should be followed by all VLOPs, for example, by allow-
ing a self -identification of researchers’ affiliations in the application form and by not dis-
regarding applications from non -academic institutions and journalists. Researchers from outsi de the EU should be allowed to request data, if they study systemic risks in the EU. 5 To still ensure the possibility for some public cross -checking and to spot potentially abu-
sive behavior, applicants and companies could voluntarily commit to creating a public transparency database with research conducted using Article 40(12). This could b e an expansion of what some VLOPs are already doing based on voluntary commitments un-
der the EU’s Code of Practice on Disinformation (see sample case 2 below). Furthermore, it would be helpful if VLOPs better allowed for organizational applica-
tions instead of granting access on a project -by-project basis , as this would align more closely with the operational means by which not -for-profit research institutions leverage public data. It would also better allow monitoring of ongoing societal issues, potentially in real time, as recital 98 mentions, without ha ving to file multiple requests for the same research topic. 3. Types of research questions Status quo: Requirements for suitable research questions are interpreted too strictly. At times, applications have been rejected because the proposed research questions supposedly do not meet the requirements of the DSA, which call for research to be conducted on systemic risks (see sample case 1). This is often based on companies’ strict interpretation of Article 40(12), which is not in line with its overall goal of enabling wide -
ranging and timely studies by a variety of researchers. Similarly, platforms often ask for proof of technical -operational measures to secure data that are outsized for the type of data requested under Article 40(12). This 


key: chroma:document
string_value:
overall goal of enabling wide -
ranging and timely studies by a variety of researchers. Similarly, platforms often ask for proof of technical -operational measures to secure data that are outsized for the type of data requested under Article 40(12). This can be an unnecessary obstacle for researchers, especially for organizations that do not have the personnel and/or resources to use separate research infrastructure just for Article 40(12) studies. Sample case 1: Article 40(12) requests to X As a designated VLOP under the DSA, X has been required to comply with Article 40(12) since August 2023. Various researchers who have tried to gain access to publicly acces-
sible data have reported rejections from X. The reason that was given often was that “it does not appear that your proposed use of X data is solely for performing research that contri butes to the detection, identification, and understanding of systemic risks in the EU.” While this wording is found in Article 40(12), it is an unnecessarily narrow inter-
pretation of the provision to restrict data access by claiming a request is not specif ic enough without further explanations. 6 Suggestion: VLOPs need to differentiate between requirements for Articles 40(4) and 40(12) DSA. Given the public nature of the requested data (for instance, publicly available videos or engagement metrics such as “likes”), the eligibility criteria for Article 40(12) should not be mistaken with access criteria under Article 40(4) in connection with Article 40(8). It is important to clarify this difference to platforms. For instance, Article 40(12) does not foresee t he same vetting process that is required by Article 40(4) and 40(8) - which is to be conducted by regulators and not companies, nonetheless. In neither case, VLOPs are tasked with checking the feasibility of research questions. The point of Article 40(12) is precisely not 


key: chroma:document
string_value:
is required by Article 40(4) and 40(8) - which is to be conducted by regulators and not companies, nonetheless. In neither case, VLOPs are tasked with checking the feasibility of research questions. The point of Article 40(12) is precisely not to have an elaborate vetting process because the data in question is already public. In this line, a restrictive understanding of the connection to systemic risks is not pro-
portional , considering that Article 40(12) is also meant to enable monitoring of topics in real time, if technically possible. More generally, it is arguably prohibitive to demand that requests for public platform data can be solely used for only one highly specific research purpose. Similarly, while researchers certainly need to adhere to data protection law when handling Article 40(12) data, the privacy risks associate d with research using such data are much lower than for non -public data (which “vetted researchers” will be able to re-
quest under Article 40(4) and 40(8)). 4. Resp onses to requests Status quo: Responses take too long and explanations about rejections are too vague. Researchers often have to wait too long to hear back from platforms about their requests. For example, preliminary data from the DSA 40 Data Access Tracker show that for X, the average response time to data access requests is 1.5 months . Given the small num-
ber of requirements checked in this application and the public nature of the data, this timeframe is severely delaying data access requests. Moreover, rejections are often not well explained (see also point 2 above). For instance, access requests to X have gotten rejected with statements such as “application is incom-
plete or lacks sufficient detail” or “until we receive any contrary legislation or guidance, X will limit API access under Artic le 40(12) to organizations located in the 


key: chroma:document
string_value:
requests to X have gotten rejected with statements such as “application is incom-
plete or lacks sufficient detail” or “until we receive any contrary legislation or guidance, X will limit API access under Artic le 40(12) to organizations located in the EU” (see sample case 2 below; also sample case 1 above). Both are not sufficiently explained or helpful for researchers so they can adjust future requests. 7 Sample case 2: “Empowering researchers” under the Code of Practice on Disinfor-
mation While not directly related to Article 40(12), the voluntary commitments various VLOPs have made under the EU’s Code of Practice on Disinformation still shine a light on vari-
ous approaches to researcher access to data. For example, the latest report on the Code from March 2024 shows that some companies publish the number and approvals of re-
quests to their application programming interfaces (APIs), others do not. The report also shows that documentation on APIs and data access varies widely. Overall, it becomes clear that some o f the open questions related to Article 40(12) are recurring themes from other debates in need of clarification via cross -platform, EU -wide guidance. Suggestion: Actionable responses should come within three weeks and provide substantive explanations. An important goal of Article 40(12) is enabling fast, data -driven research as well as mon-
itoring of current societal topics (as recital 98 mentions). The DSA also states that data should be provided in real time, if technically possible. Achieving this goa l is severely hindered if responses take longer than three weeks . Especially in relation to current events, but also in the planning of resources for research projects, response times longer than three weeks carry the risk of sinking some research projects . Moreover, researchers require substantive and actionable explanations for why their requests were rejected. While VLOPs 


key: chroma:document
string_value:
but also in the planning of resources for research projects, response times longer than three weeks carry the risk of sinking some research projects . Moreover, researchers require substantive and actionable explanations for why their requests were rejected. While VLOPs cannot and should not rephrase research questions for researchers, the applicants need to at least understand what caused the rejection, so they can improve and revise or re -submit access requests. 5. Types of data accessed Status quo: Documentation of accessible data is lacking. Some VLOPs do not document the functionality and accessible data researchers can apply for under Article 40(12). This complicates the application process as researchers either cannot be specific in their application texts or researchers try to be specific but platforms can reject an application base d on the mismatch between proposed research and actual platform access (see sample case 3). 8 Sample case 3: Lack of understanding what data TikTok does and does not make available TikTok promotes its Research API as a way to access various types of data, along with dedicated documentation. This is generally a helpful approach but the documentation pre-
viously offered conflicting information on certain issues such as queries. Moreover , it is unclear why some data is available via the Research API and other data is not (as re-
searchers have found that other sources provide deeper insights). Suggestion: Platforms should provide clear access mode documentation. It would be highly beneficial for researchers if VLOPs provided clear documentation on the access to public data , as some companies do based in part on their voluntary commitments under the EU’s Code of Practice on Disinformation. This could be achieved through a dedicated overview of public data that can be requested through their APIs and/or by highlighting the da ta fields considered public data 


key: chroma:document
string_value:
on their voluntary commitments under the EU’s Code of Practice on Disinformation. This could be achieved through a dedicated overview of public data that can be requested through their APIs and/or by highlighting the da ta fields considered public data in their API documentation. Information should also cover any rate limits or other restrictions of access. This is similar to what is already in place for access to commercial APIs. Any restrictions need to be transparent, justified and in accordance with Article 40(12). 6. Changes once data access has been granted Status quo: Restrictions occur after data access requests have been granted. In some of the few known cases where data access has been granted, access has been changed and restricted after it was granted (see sample case 4). This complicates re-
searcher data access, as a change in the empirical basis can reduce the explanatory power of data and with this, the assessment of systemic risks in general. Sample case 4: Granted access to TikTok API is attempted to be revoked. After a researcher was granted access to TikTok’s Research API, the company sent an email to the researcher stating that “After careful review of your application, it appears your research project as proposed would violate the Research API Terms of Service (...) Could you please confirm that there will be no breach of our Terms of Service and provide clarification of your research design if you believe that there will be no breach?” There is no information provided that is specific to the research project, explaining where TikTok sees a breach of its terms of service. Crucially, there is no referral to the researcher’ s alleged non -compliance with the DSA under which access had been granted. The refer-
ence to corporate terms of service to revoke legally protected data 


key: chroma:document
string_value:
a breach of its terms of service. Crucially, there is no referral to the researcher’ s alleged non -compliance with the DSA under which access had been granted. The refer-
ence to corporate terms of service to revoke legally protected data access seems to be at odds with the DSA. 9 Suggestion: Any changes to data access should be announced in advance and ex-
plained. While changes in technical infrastructure are inevitable, such changes need to be proac-
tively announced and communicated by platforms for researchers who have received data access, including specific and substantive explanations. Planned changes need to be made public in the documentation, preferably on dedicated researcher websites. 7. Costs No change to status quo necessary: Access requests under Article 40(12) are free. So far, it seems that researchers are not being charged for requesting data under Article 40(12). This should not change. The whole point of the article is to allow fast, free, low -
barrier access to data that is already publicly available. Any financial ba rriers erected by VLOPs would run counter to this. This is especially pertinent since some replacements to CrowdTangle (see point 9 below) or to Article 40(12) access touted by platforms are fee -
based social media monitoring services and as such not fittin g alternatives . 8. Terms and Conditions Status quo: Policies regarding data retention, refresh, sharing, and pre -publication review are often at odds with how research is conducted. The terms and conditions of several VLOP’s data access rules require researchers who want to access public data to agree to submit any publications they generate using that data to the VLOP for review . This significantly hinders researchers from carrying out and publishing research in the public interest, especially when that research may run counter to the interest of the company. Moreover, 


key: chroma:document
string_value:
publications they generate using that data to the VLOP for review . This significantly hinders researchers from carrying out and publishing research in the public interest, especially when that research may run counter to the interest of the company. Moreover, academic research norms often require the long -term retention of data for analysis, open data for replication and the independent sharing of results in peer -reviewed journals, yet some VLOP data access programs, such as TikTok’s Research API, require that researchers refresh data every fifteen days, bars researchers from sharing data and requires that researchers send th eir papers to TikTok thirty days in advance of publication. Suggestion: Abolish pre -publication review. VLOPs should refrain from having any pre -publication reviews as a requirement for obtaining access to public data under Article 40(12). Terms and conditions should not be overly burdensome (or counter -intuitive) to producing public -interest research. They 10 should also clearly establish how data can be shared within a project team. In turn, re-
searchers using Article 40(12) should generally commit to make their study results pub-
licly and freely available, even though this is not legally required. 9. Existing Access Status quo: Data access modes that have existed prior to Article 40(12) are about to be discontinued. Meta has announced plans to discontinue access to platform data via Crowdtangle on August 14, 2024. This creates serious issues for researchers because it leads to a cap of existing and longitudinal research projects. It is especially unfortunate that this happens during a year with many elections across the world, including the Euro pean Parliament and US presidential elections, which leaves a gap in public data access for pre - and post -
election monitoring that the new Meta content library is not able to fi ll. Suggestion: Existing data access modes 


key: chroma:document
string_value:
the Euro pean Parliament and US presidential elections, which leaves a gap in public data access for pre - and post -
election monitoring that the new Meta content library is not able to fi ll. Suggestion: Existing data access modes should be continued until a satisfactory new data access model under Article 40(12) is in place. As mentioned in the open letter initiated by the Mozilla Foundation , existing data access modes need to be continued until all VLOPs fully comply with public data access under Article 40(12). At minimum, this should be considered as developing sufficiently robust data access tools and granting access to a variety of public interest researchers, particu-
larly those who ha ve requested access to public data and have not yet heard back from VLOPs. Companies should establish (or continue and expand their existing) consultations with the wider research community, not only academic researchers, to ensure that their programs meet the ambitions of the regulation as laid out in Article 40(12) . We encourage VLOPs to ensure compliance with Article 40(12) and regulators at the European and national levels to continue their oversight work on this important provision. Specifically, we encourage the Commission and the European Board for Digital Servic es to develop guidelines for Article 40(12) that address some of the challenges and open questions described here.


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\X research for academics and marketers _ Twitter Developer Platform.pdf


key: chroma:document
string_value:
Research global healthCombat hate speechStudy public sentiment
Monitoring COVID-19perceptions andhotspotsUsing linguistic markers in posts, the team at the Center forCenter forDigital Health at Penn MedicineDigital Health at Penn Medicine shows how attitudesabout COVID-19 vary by region, and can potentially identifyemerging hotspots based on aggregate increases in symptomsbeing discussed. Information from this dashboard can be usedby health systems and policy makers to provide current,hyperlocal, and actionable information to their communities.Relevant endpoints: Filtered streamFiltered stream
Learn more about Penn Medicine Center for Digital Health→
Get started nowBegin using the X API in seconds with our access plans.Subscribe now
DEVELOPER POLICY AND TERMSFOLLOW IXDEVELOPERSSubscribe to developer news
X platform
X.com
Status
Accessibility
Embed a post
Privacy Center
Transparency Center
Download the X app
X Corp.
About the company
Company news
Brand toolkit
Jobs and internships
Investors
Help
Help Center
Using X
X for creators
Ads Help Center
Managing your account
Email Preference Center
Rules and policies
Contact us
Developer resources
Developer home
Documentation
Forums
Communities
Developer blog
Engineering blog
Developer terms
Business resources
Advertise
X for business
Resources and guides
X for marketers
Marketing insights
Brand inspiration
X Ads Academy
© 2024 X Corp.
Cookies
Privacy
Terms and conditionsResearch under EUDigital Services ActQualified research under the Article 40 of the DigitalServices Act may apply for X API access. Note: this application is only for a narrow subset of EUresearch related to the DSA. For general academicresearch, please enroll in one of our X API access tiers.Apply nowDoresearchUse the X API to get historical and real-time data points for your next researchproject.
Listen to and understandwhat’s happening on XConduct academic researchFrom social science to computer science, advance nearly any researchobjective on topics as diverse as the global conversations happening on X.Learn more →Solve problems with applied research for NGOsUse X data to conduct scientific studies that solve problems to impact themission of your non-profit organization or lab.Enrich investigative journalism and independent researchUse X data to explore global to local topics and events that can inform projectsand publications.Conduct market research for businessUnderstand your audience and what they value by uncovering trends andsurfacing important conversations 


key: chroma:document
string_value:
non-profit organization or lab.Enrich investigative journalism and independent researchUse X data to explore global to local topics and events that can inform projectsand publications.Conduct market research for businessUnderstand your audience and what they value by uncovering trends andsurfacing important conversations on X.Learn more →
Products
Docs
Use Cases
Community
Support
Developer Portal
Developer Platform


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\YouTube Data API Overview  _  Google for Developers.pdf


key: chroma:document
string_value:
BlogThe latest news on theYouTube blogGitHubFind API code samples andother YouTube open-sourceprojects.Issue TrackerSomething wrong? Send usa bug report!Stack OverflowAsk a question under theyoutube-api tagVideosCheck out the YouTubeDeveloper Relations team'sYouTube channelToolsGoogle APIs ExplorerYouTube Player DemoConKgure a Subscribe ButtonIssue TrackerFile a bugRequest a featureSee open issuesProduct InfoTerms of ServiceBranding GuidelinesMonetization GuidelinesAPIs subject to Deprecation PolicyAndroidChromeFirebaseGoogle Cloud PlatformGoogle AIAll productsTerms|PrivacySign up for the Google for Developers newsletterSubscribe

HomeProductsYouTubeData APIGuidesWas this helpful?YouTube Data API Overview IntroductionThis document is intended for developers who want to write applications that interact with YouTube. It explains basic conceptsof YouTube and of the API itself. It also provides an overview of the different functions that the API supports.Before you start1. You need a Google Account to access the Google API Console, request an API key, and register your application.2. Create a project in the Google Developers Console and obtain authorization credentials so your application can submitAPI requests.3. After creating your project, make sure the YouTube Data API is one of the services that your application is registered touse:a. Go to the API Console and select the project that you just registered.b. Visit the Enabled APIs page. In the list of APIs, make sure the status is ON for the YouTube Data API v3.4. If your application will use any API methods that require user authorization, read the authentication guide to learn how toimplement OAuth 2.0 authorization.5. Select a client library to simplify your API implementation.]. Familiarize yourself with the core concepts of the JSON (JavaScript Object Notation) data format. JSON is a common,language-independent data format that provides a simple text representation of arbitrary data structures. For moreinformation, see json.org.Resources and resource typesA resource is an individual data entity with a unique identiKer. The table below describes the different types of resources thatyou can interact with using the API.ResourcesactivityContains information about 


key: chroma:document
string_value:
representation of arbitrary data structures. For moreinformation, see json.org.Resources and resource typesA resource is an individual data entity with a unique identiKer. The table below describes the different types of resources thatyou can interact with using the API.ResourcesactivityContains information about an action that a particular user has taken on the YouTube site. User actions thatare reported in activity feeds include rating a video, sharing a video, marking a video as a favorite, andposting a channel bulletin, among others.channelContains information about a single YouTube channel.channelBannerIdentiKes the URL to use to set a newly uploaded image as the banner image for a channel.channelSectionContains information about a set of videos that a channel has chosen to feature. For example, a sectioncould feature a channel's latest uploads, most popular uploads, or videos from one or more playlists.guideCategoryIdentiKes a category that YouTube associates with channels based on their content or other indicators, suchas popularity. Guide categories seek to organize channels in a way that makes it easier for YouTube users toKnd the content they're looking for. While channels could be associated with one or more guide categories,they are not guaranteed to be in any guide categories.i18nLanguageIdentiKes an application language that the YouTube website supports. The application language can also bereferred to as a UI language.i18nRegionIdentiKes a geographic area that a YouTube user can select as the preferred content region. The contentregion can also be referred to as a content locale.playlistRepresents a single YouTube playlist. A playlist is a collection of videos that can be viewed sequentially andshared with other users.playlistItemIdentiKes a resource, such as a video, that is part of a playlist. The playlistItem resource also containsdetails that explain how the included resource is used in the playlist.search resultContains information about a YouTube video, channel, or playlist that matches the search parametersspeciKed in an API 


key: chroma:document
string_value:
video, that is part of a playlist. The playlistItem resource also containsdetails that explain how the included resource is used in the playlist.search resultContains information about a YouTube video, channel, or playlist that matches the search parametersspeciKed in an API request. While a search result points to a uniquely identiKable resource, like a video, itdoes not have its own persistent data.subscriptionContains information about a YouTube user subscription. A subscription notiKes a user when new videosare added to a channel or when another user takes one of several actions on YouTube, such as uploading avideo, rating a video, or commenting on a video.thumbnailIdentiKes thumbnail images associated with a resource.videoRepresents a single YouTube video.videoCategoryIdentiKes a category that has been or could be associated with uploaded videos.watermarkIdentiKes an image that displays during playbacks of a speciKed channel's videos. The channel owner canalso specify a target channel to which the image links as well as timing details that determine when thewatermark appears during video playbacks and then length of time it is visible.Note that, in many cases, a resource contains references to other resources. For example, a playlistItem resource'ssnippet.resourceId.videoId property identiKes a video resource that, in turn, contains complete information about thevideo. As another example, a search result contains either a videoId, playlistId, or channelId property that identiKes aparticular video, playlist, or channel resource.Supported operationsThe following table shows the most common methods that the API supports. Some resources also support other methods thatperform functions more speciKc to those resources. For example, the videos.rate method associates a user rating with avideo, and the thumbnails.set method uploads a video thumbnail image to YouTube and associates it with a video.OperationslistRetrieves (GET) a list of zero or more resources.insertCreates (POST) a new resource.updateModiKes (PUT) an existing resource to redect data in your request.deleteRemoves (DELETE) a speciKc resource.The API 


key: chroma:document
string_value:
uploads a video thumbnail image to YouTube and associates it with a video.OperationslistRetrieves (GET) a list of zero or more resources.insertCreates (POST) a new resource.updateModiKes (PUT) an existing resource to redect data in your request.deleteRemoves (DELETE) a speciKc resource.The API currently supports methods to list each of the supported resource types, and it supports write operations for manyresources as well.The table below identiKes the operations that are supported for different types of resources. Operations that insert, update, ordelete resources always require user authorization. In some cases, list methods support both authorized and unauthorizedrequests, where unauthorized requests only retrieve public data while authorized requests can also retrieve information aboutor private to the currently authenticated user.Supported OperationslistinsertupdatedeleteactivitycaptionchannelchannelBannerchannelSectioncommentcommentThreadguideCategoryi18nLanguagei18nRegionplaylistplaylistItemsearch resultsubscriptionthumbnailvideovideoCategorywatermarkQuota usageThe YouTube Data API uses a quota to ensure that developers use the service as intended and do not create applications thatunfairly reduce service quality or limit access for others. All API requests, including invalid requests, incur at least a one-pointquota cost. You can Knd the quota available to your application in the API Console.Projects that enable the YouTube Data API have a default quota allocation of 10,000 units per day, an amount suecient for theoverwhelming majority of our API users. Default quota, which is subject to change, helps us optimize quota allocations andscale our infrastructure in a way that is more meaningful to our API users. You can see your quota usage on the Quotas page inthe API Console.Note: If you reach the quota limit, you can request additional quota by completing the Quota extension request form for YouTube APIServices.Calculating quota usageGoogle calculates your quota usage by assigning a cost to each request. Different types of operations have different quotacosts. For example:A read operation that retrieves a list of resources -- channels, videos, playlists -- usually costs 1 unit.A write operation that creates, 


key: chroma:document
string_value:
your quota usage by assigning a cost to each request. Different types of operations have different quotacosts. For example:A read operation that retrieves a list of resources -- channels, videos, playlists -- usually costs 1 unit.A write operation that creates, updates, or deletes a resource usually has costs 50 units.A search request costs 100 units.A video upload costs 1600 units.The Quota costs for API requests table shows the quota cost of each API method. With these rules in mind, you can estimatethe number of requests that your application could send per day without exceeding your quota.Partial resourcesThe API allows, and actually requires, the retrieval of partial resources so that applications avoid transferring, parsing, andstoring unneeded data. This approach also ensures that the API uses network, CPU, and memory resources more eeciently.The API supports two request parameters, which are explained in the following sections, that enable you to identify theresource properties that should be included in API responses.The part parameter identiKes groups of properties that should be returned for a resource.The fields parameter Klters the API response to only return speciKc properties within the requested resource parts.How to use the part parameterThe part parameter is a required parameter for any API request that retrieves or returns a resource. The parameter identiKesone or more top-level (non-nested) resource properties that should be included in an API response. For example, a videoresource has the following parts:snippetcontentDetailsfileDetailsplayerprocessingDetailsrecordingDetailsstatisticsstatussuggestionstopicDetailsAll of these parts are objects that contain nested properties, and you can think of these objects as groups of metadata Keldsthat the API server might (or might not) retrieve. As such, the part parameter requires you to select the resource componentsthat your application actually uses. This requirement serves two key purposes:It reduces latency by preventing the API server from spending time retrieving metadata Kelds that your application doesn'tuse.It 


key: chroma:document
string_value:
retrieve. As such, the part parameter requires you to select the resource componentsthat your application actually uses. This requirement serves two key purposes:It reduces latency by preventing the API server from spending time retrieving metadata Kelds that your application doesn'tuse.It reduces bandwidth usage by reducing (or eliminating) the amount of unnecessary data that your application mightretrieve.Over time, as resources add more parts, these beneKts will only increase since your application will not be requesting newlyintroduced properties that it doesn't support.How to use the fields parameterThe fields parameter Klters the API response, which only contains the resource parts identiKed in the part parameter value,so that the response only includes a speciKc set of Kelds. The fields parameter lets you remove nested properties from anAPI response and thereby further reduce your bandwidth usage. (The part parameter cannot be used to Klter nestedproperties from a response.)The following rules explain the supported syntax for the fields parameter value, which is loosely based on XPath syntax:Use a comma-separated list (fields=a,b) to select multiple Kelds.Use an asterisk (fields=*) as a wildcard to identify all Kelds.Use parentheses (fields=a(b,c)) to specify a group of nested properties that will be included in the API response.Use a forward slash (fields=a/b) to identify a nested property.In practice, these rules often allow several different fields parameter values to retrieve the same API response. For example,if you want to retrieve the playlist item ID, title, and position for every item in a playlist, you could use any of the followingvalues:fields=items/id,playlistItems/snippet/title,playlistItems/snippet/positionfields=items(id,snippet/title,snippet/position)fields=items(id,snippet(title,position))Note: As with all query parameter values, the fields parameter value must be URL encoded. For better readability, the examples in thisdocument omit the encoding.Sample partial requestsThe examples below demonstrate how you can use the part and fields parameters to ensure that API responses onlyinclude the data that your application uses:1. Example 1 returns 


key: chroma:document
string_value:
encoded. For better readability, the examples in thisdocument omit the encoding.Sample partial requestsThe examples below demonstrate how you can use the part and fields parameters to ensure that API responses onlyinclude the data that your application uses:1. Example 1 returns a video resource that includes four parts as well as kind and etag properties.2. Example 2 returns a video resource that includes two parts as well as kind and etag properties.3. Example 3 returns a video resource that includes two parts but excludes kind and etag properties.4. Example 4 returns a video resource that includes two parts but excludes kind and etag as well as some nestedproperties in the resource's snippet object.
Optimizing performanceUsing ETagsETags, a standard part of the HTTP protocol, allow applications to refer to a speciKc version of a particular API resource. Theresource could be an entire feed or an item in that feed. This functionality supports the following use cases:Caching and conditional retrieval – Your application can cache API resources and their ETags. Then, when yourapplication requests a stored resource again, it speciKes the ETag associated with that resource. If the resource haschanged, the API returns the modiKed resource and the ETag associated with that version of the resource. If the resourcehas not changed, the API returns an HTTP 304 response (Not Modified), which indicates that the resource has notchanged. Your application can reduce latency and bandwidth usage by serving cached resources in this manner.The client libraries for Google APIs differ in their support of ETags. For example, the JavaScript client library supportsETags via a whitelist for allowed request headers that includes If-Match and If-None-Match. The whitelist allowsnormal browser caching to occur so that if a resource's ETag has not changed, the resource can be served from thebrowser cache. The Obj-C client, on the other hand, does 


key: chroma:document
string_value:
allowed request headers that includes If-Match and If-None-Match. The whitelist allowsnormal browser caching to occur so that if a resource's ETag has not changed, the resource can be served from thebrowser cache. The Obj-C client, on the other hand, does not support ETags.Protecting against inadvertent overwrites of changes – ETags help to ensure that multiple API clients don't inadvertentlyoverwrite each other's changes. When updating or deleting a resource, your application can specify the resource's ETag. Ifthe ETag doesn't match the most recent version of that resource, then the API request fails.Using ETags in your application provides several beneKts:The API responds more quickly to requests for cached but unchanged resources, yielding lower latency and lowerbandwidth usage.Your application will not inadvertently overwrite changes to a resource that were made from another API client.The Google APIs Client Library for JavaScript supports If-Match and If-None-Match HTTP request headers, therebyenabling ETags to work within the context of normal browser caching.Using gzipYou can also reduce the bandwidth needed for each API response by enabling gzip compression. While your application willneed additional CPU time to uncompress API responses, the beneKt of consuming fewer network resources usually outweighsthat cost.To receive a gzip-encoded response you must do two things:Set the Accept-Encoding HTTP request header to gzip.Modify your user agent to contain the string gzip.The sample HTTP headers below demonstrate these requirements for enabling gzip compression:
Was this helpful?Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its aeliates.Last updated 2023-11-08 UTC.
Example 1Example 2Example 3Example 4URL:Description:API response:{ "kind": "youtube#videoListResponse", "etag": "\"UCBpFjp2h75_b92t44sqraUcyu0/sDAlsG9NGKfr6v5AlPZKSEZdtqA\"", "videos": [ { "id": "7lCDEYXw3mM", "kind": "youtube#video", "etag": "\"UCBpFjp2h75_b92t44sqraUcyu0/iYynQR8AtacsFUwWmrVaw4Smb_Q\"", "snippet": { "publishedAt": "2012-06-20T22:45:24.000Z", "channelId": "UC_x5XG1OV2P6uZZ5FSM9Ttw", "title": 


key: chroma:document
string_value:
Site Policies. Java is a registered trademark of Oracle and/or its aeliates.Last updated 2023-11-08 UTC.
Example 1Example 2Example 3Example 4URL:Description:API response:{ "kind": "youtube#videoListResponse", "etag": "\"UCBpFjp2h75_b92t44sqraUcyu0/sDAlsG9NGKfr6v5AlPZKSEZdtqA\"", "videos": [ { "id": "7lCDEYXw3mM", "kind": "youtube#video", "etag": "\"UCBpFjp2h75_b92t44sqraUcyu0/iYynQR8AtacsFUwWmrVaw4Smb_Q\"", "snippet": { "publishedAt": "2012-06-20T22:45:24.000Z", "channelId": "UC_x5XG1OV2P6uZZ5FSM9Ttw", "title": "Google I/O 101: Q&A On Using Google APIs", "description": "Antonio Fuentes speaks to us and takes questions on working with Google APIs and OAuth 2.0.", "thumbnails": { "default": { "url": "https://i.ytimg.com/vi/7lCDEYXw3mM/default.jpg" }, "medium": { "url": "https://i.ytimg.com/vi/7lCDEYXw3mM/mqdefault.jpg" }, "high": { "url": "https://i.ytimg.com/vi/7lCDEYXw3mM/hqdefault.jpg" } }, "categoryId": "28" }, "contentDetails": { "duration": "PT15M51S", "aspectRatio": "RATIO_16_9" }, "statistics": { "viewCount": "3057", "likeCount": "25", "dislikeCount": "0", "favoriteCount": "17", "commentCount": "12" }, "status": { "uploadStatus": "STATUS_PROCESSED", "privacyStatus": "PRIVACY_PUBLIC" } } ]}
Accept-Encoding: gzipUser-Agent: my program (gzip)
English
OverviewClient LibrariesAuthorize RequestsOverviewGet Auth CredentialsServer-side Web AppsClient-side Web AppsInstalled AppsDevicesQuickstartsAndroidApps ScriptGoiOSJavaJavaScriptNode.jsFilter

HomeGuidesReferenceSamplesSupport
developers.google.com uses cookies from Google to deliver and enhance the quality of its services and to analyze traec. Learn more.
OK, got it
InfoChatAPIYouTubeData APIEnglish
Join the Google Developer ProgramUnlock AI tools, exclusive training, and insideraccess. Join today and accelerate your developerjourney.DismissStartSearch/


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\YouTube Research - How It Works.pdf


key: chroma:document
string_value:
How itworksSee an overview of the program and answers tocommon questions.Program overviewThis program is for academic researchers interested in using YouTube’sglobal Data API for their next research project. Here’s how it works:
What data isavailable?We’re starting this program withscaled, expanded access to globalvideo metadata across the entirepublic YouTube corpus via our DataAPI. Learn more about what data isavailable in the YouTube APIreference. We encourage allresearchers with clear research goalsto apply. We’re excited to work withyou and learn which additional toolsand data could support your work.Frequently askedquestionsBelow, you’ll find answers to common questionsabout the program.
Ready to join the program?APPL Y NOW
Confirm your eligibilityVerify that you’re an academic researcheraffiliated with an accredited, higher-learninginstitution.View entry criteria 1Create a Google CloudprojectBefore you apply, you’ll need to create an APIproject in the Google Cloud Console. Getstarted by visiting the enabled APIs page.Read the guide 2Submit your applicationApply with your institutional email (such as.edu), include as much detail as possible,and confirm that all of your information isaccurate.View the application 3
Who counts as a qualified researcher?A qualified researcher is a student, research-focused staff, or faculty memberaffiliated with an accredited higher-learning institution.View entry criteria What can researchers study with YouT ube’s Data API?I’ve already applied for an increase in the Data API quotafor academic studies through this form. Do I need to applyseparately to YouTube’s Researcher Program?A researcher is proposing I grant OAuth access to helpthem with their study. Is this allowed?Beyond scaled Data API access, do you have a roadmap ofexpanded products, features, and services for theprogram?What is considered an “eligible” academic institution?What standards do you use to determine if an academicinstitution is “accredited”?Why isn't my accredited institution on the eligibleaccredited institutions list?What countries is the YouT ube Researcher Programavailable in?Why isn’t the YouT ube Researcher Program available in mycountry?
ConnectAbout YouTubeAboutBlogHow YouTube WorksJobsPressYouTube Culture & TrendsNFL Sunday TicketProductsYouTube 


key: chroma:document
string_value:
determine if an academicinstitution is “accredited”?Why isn't my accredited institution on the eligibleaccredited institutions list?What countries is the YouT ube Researcher Programavailable in?Why isn’t the YouT ube Researcher Program available in mycountry?
ConnectAbout YouTubeAboutBlogHow YouTube WorksJobsPressYouTube Culture & TrendsNFL Sunday TicketProductsYouTube KidsYouTube MusicYouTube OriginalsYouTube PodcastsYouTube PremiumYouTube SelectYouTube StudioYouTube TVFor BusinessDevelopersYouTube AdvertisingFor CreatorsCreating for YouTube KidsCreator ResearchCreator Services DirectoryYouTube ArtistsYouTube CreatorsYouTube NextUpYouTube VROur CommitmentsCreators for ChangeCSAI MatchSocial Impact
Policies & SafetyCopyrightBrand GuidelinesPrivacyTermsHelpAPPL Y NOWHomeHow it WorksPolicies


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\🤦‍♀️ The Research API falls woefully short _ auditing TikTok.pdf


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\META\Advanced search - Content Library and API.pdf


key: chroma:document
string_value:
Docume…Content Library and A…Content Library A…Guid…Advanced sear…Su questa PaginaAdvanced search guidelinesMeta Content Library and API have a search functionality that supports AND, OR, and NOToperators. Query strings are passed as the q parameter as in this example (select the tab for thelanguage of your choice):
response <- client$get( path="search/facebook_posts", params=list("q"="dogs | cats & pets"))General rulesThe following general rules apply to forming queries:The following operators are supported: AND, OR, NOT.Use an ampersand character (&) or a blank space to indicate AND.Use a pipe character ( | ) to indicate OR.Use a hyphen character (-) to indicate NOT. The en-dash and em-dash characters arenot interpreted as substitutes for hyphen and are treated instead as keywords.For queries with multiple operators, NOT clauses are processed first, followed by AND,followed by OR. Imagine the terms grouped as if with parentheses.For clauses of equal precedence, there is a default left-to-right processing order.Grouping using parentheses is supported. Grouping can be used to modify the defaultprocessing order.You can use single-word keywords only (not phrases).Wild cards are not supported.Extra spaces around operators are ignored, so you can have them or not.
R
PythonBecause they have special meaning in the context of query syntax, the following characters cannotbe used as keywords or embedded in keywords:& ampersand| pipe- hyphenspace( open parenthesis) close parenthesisAdditional information regarding searches is available in Advanced search.
Using operatorsThe examples included here demonstrate the basic use of the AND, OR, and NOT operators.Search objectiveSearch objectiveHow to write itHow to write itExamplesExamplesFind matches that include all ofthe provided search terms.Use the AND operatorexpressed as an ampersandcharacter (&) or a blank space.cat&dog&allergycat dog allergycat&dog allergycat dog&allergyEach match contains all threeterms: “cat”, “dog”, and “allergy”.Find matches that include atleast one of the provided searchterms.Use the OR operator expressedas a pipe character (|).cat | dogcat|dogcat |dogcat| dogEach match contains “cat” or“dog”, and could contain both.Find 


key: chroma:document
string_value:
allergycat&dog allergycat dog&allergyEach match contains all threeterms: “cat”, “dog”, and “allergy”.Find matches that include atleast one of the provided searchterms.Use the OR operator expressedas a pipe character (|).cat | dogcat|dogcat |dogcat| dogEach match contains “cat” or“dog”, and could contain both.Find matches that include theprovided search term, excludinga second term.Use the NOT operatorexpressed as a hyphencharacter (-).dog -puppydog-puppydog- puppydog - puppyEach match contains “dog” butnot “puppy”. Results containingboth “dog” and “puppy” areexcluded.
Multiple operatorsWhen multiple operators are included in a single query string, the operators are processed (parsed)in a specific order: NOT first, followed by AND, followed by OR. This is important to understandbecause it means the order in which you place the operators in your query might be diﬀerent fromthe order in which they are parsed, which might or might not aﬀect the results.The examples in this section demonstrate the use of multiple operators in a single query.Search objectiveSearch objectiveHow to write itHow to write itExamplesExamplesFind matches that include bothof two search terms (ANDclause), as well as matches thatinclude a third term (OR clause).Use both an AND clause and anOR clause. The AND clause isparsed ﬁrst.lemon lime | grapefruitgrapefruit | lemon limeResults include matchescontaining both “lemon” and“lime”, plus those containing“grapefruit”.Find:1. Matches that contain onesearch term, excludingthose containing a secondterm, and2. Matches that contain athird termNote: Some matches might meetboth criteria 1 and 2, but to beincluded in the query results, theonly requirement is to match atleast one.Use both a NOT clause and anOR clause. The NOT clause isparsed ﬁrst.fuyu | persimmon - astringentpersimmon - astringent | fuyuResults include:1. Matches containing“persimmon” but not“astringent” (imaginepersimmon - astringentgrouped as if inparentheses), and2. Matches containing “fuyu”Some matches might contain“persimmon” but not “astringent”and also contain “fuyu”(matching both 1 and 2 above),but this is not a requirement tobe included in the query results.Note: If you actually want 


key: chroma:document
string_value:
not“astringent” (imaginepersimmon - astringentgrouped as if inparentheses), and2. Matches containing “fuyu”Some matches might contain“persimmon” but not “astringent”and also contain “fuyu”(matching both 1 and 2 above),but this is not a requirement tobe included in the query results.Note: If you actually want toexclude “astringent” from “fuyu”as well, you could achieve thatusing grouping, a technique forcustomizing the order ofprecedence. See the nextsection on Grouping.GroupingYou can use grouping with parentheses to influence the order in which clauses are parsed. Clausesenclosed in parentheses are parsed first, followed by operators outside of parentheses.The examples shown here demonstrate how this works.Search objectiveSearch objectiveHow to write itHow to write itExamplesExamplesFind matches that contain atleast one of two search terms,excluding those that also containa third term.Use an OR clause enclosed inparentheses to ensure it isparsed ﬁrst, followed by a NOTclause. Without the parentheses,the NOT clause would be parsedﬁrst.(fuyu | persimmon) - astringentResults include matchescontaining either “fuyu” or“persimmon” (or both), butexclude those that also contain“astringent”.Find matches that contain bothof two search terms or at leastone of two other search terms.Exclude from that list all resultsthat also contain a ﬁfth searchterm.Use an AND clause inparentheses, and an OR clausein parentheses. Separate thetwo parenthetical clauses by anOR operator. Group those twogroupings together. Finally, addthe NOT clause.The extra grouping ensures that"outlaw" is not excluded onlyfrom the (newman | redford)results, but also from the (actionmovie) results.((action movie) | (newman |redford)) - outlawResults:Include matchescontaining both “action”and “movie”Include matchescontaining either“newman” or “redford”(can contain both)Exclude matches that alsocontain “outlaw”Right-to-left languagesA few notes about queries when applied to languages that are read right to left:Content Library and APIGet accessQuick linksContent LibraryContent Library APIOverviewChangelogGetting startedGuidesFacebook PagesFacebook groupsFacebook eventsFacebook profilesFacebook postsFacebook commentsInstagram accountsInstagram postsInstagram commentsID-based retrievalSearch guideAdvanced searchRate limitingData deletionAppendixSupportDisclosures and DisclaimersCitationsQuery logic for right-to-left languages is parsed right to leftThe parsing order (NOT followed by AND followed by OR) 


key: chroma:document
string_value:
accessQuick linksContent LibraryContent Library APIOverviewChangelogGetting startedGuidesFacebook PagesFacebook groupsFacebook eventsFacebook profilesFacebook postsFacebook commentsInstagram accountsInstagram postsInstagram commentsID-based retrievalSearch guideAdvanced searchRate limitingData deletionAppendixSupportDisclosures and DisclaimersCitationsQuery logic for right-to-left languages is parsed right to leftThe parsing order (NOT followed by AND followed by OR) is maintainedGrouping is not supported for right-to-left languages


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\META\Changelog - Content Library and API - Documentazione - Meta for Developers.pdf


key: chroma:document
string_value:
DocumentiContent Library and APIContent Library APIChangelogSu questa PaginaMeta Content Library APIchangelogThe changelog lists product and documentation changes per release, in reverse chronologicalorder.Note: Meta Content Library API Version 4.0 is currently live through Meta’s ResearcherPlatform. Version 4.0 is also available in the cleanroom environment provided by the Inter-university Consortium for Political and Social Research (ICPSR) at the University ofMichigan except as noted in the list below.
Version 4.0, July 25 2024Meta Content Library API v4.0 has been enhanced with the following new features:You can sort Facebook comments and fetch all comments (not just top-level replies). SeeGuide to Facebook comments data.Posts on Facebook surfaces can be distinguished between posts made by the surface ownerthemselves (i.e. a page posting to its own surface) and posts made to the surface by adiﬀerent producer.  Facebook posts data. Additionally:group_ids, event_ids, profile_ids and page_ids parameters are deprecated infavor of a unified surface_ids parameter which accepts any combination of previousparameters (An error is shown if you attempt to use a deprecated parameter.)admin_countries and owner_types are replaced with surface_countries andsurface_typesResearcher Platform only (not available in ICPSR cleanroom): You can share producer listsfrom the Meta Content Library UI and use them in the API.You can see the producer username if it is available (including posts and comments ownerinformation).  public content made from Hong Kong and Australia. See Geographic scope formore information.You can sort Facebook and Instagram posts.  Facebook posts data and Guide toInstagram posts data.Facebook posts data includes the is_branded_content flag in addition tobranded_content_page_id. See Data dictionary.The citation format was updated with a new Digital Object Identifier (DOI) that specifiesversion 4.0. Older release DOIs are still available for reference. See Citations.Version 3.0, April 18 2024Meta Content Library API v3.0 has been enhanced with the following new features. Note that as ofAugust 15, 2024, Instagram comments are included in 


key: chroma:document
string_value:
that specifiesversion 4.0. Older release DOIs are still available for reference. See Citations.Version 3.0, April 18 2024Meta Content Library API v3.0 has been enhanced with the following new features. Note that as ofAugust 15, 2024, Instagram comments are included in version 3.0.You can perform Facebook profile searches by calling the Meta Content Library API clientsearch_facebook_profiles() method.  Facebook profiles data.You can fetch comments of a Facebook post or replies to a specific Facebook comment byleveraging Meta Content Library API entity client, using the edge(“comments”) method. SeeGuide to Facebook comments data.You can fetch comments on an Instagram post or replies to a specific Instagram comment byleveraging Meta Content Library API client, by using the /comments endpoint. Instagram comments data.ID-based retrieval: This new feature allows you to fetch a Meta Content Library node by usingits Meta Content Library ID. We also support retrieval of edges to a node. See the ID-basedretrieval documentation.You can fetch more results from Instagram personal accounts as the threshold is reduced to25,000 followers.  Instagram accounts data and Guide to Instagram posts data.You can filter Facebook posts by their media type. Set the new media_types parameter toone or more available media types (like photos, videos etc).  Facebook postsdata.Instagram post data includes the name of the post owner.  mentions of eligible Facebook pages, profiles and Instagram accounts which areavailable in Meta Content Library API.The citation format was updated with a new Digital Object Identifier (DOI) that specifiesversion 3.0. Older release DOIs are still available for reference. See CitationsVersion 2.0, January 30 2024Meta Content Library API v2.0 has been enhanced with the following new features:You can search Facebook and Instagram posts by post ID. Use the post_ids parameter,specifying one or more post IDs that you obtained from a previous search. Facebook posts data and Guide to Instagram posts 


key: chroma:document
string_value:
been enhanced with the following new features:You can search Facebook and Instagram posts by post ID. Use the post_ids parameter,specifying one or more post IDs that you obtained from a previous search. Facebook posts data and Guide to Instagram posts data.A subset of Instagram personal accounts that match qualification criteria can be included inresults when you search for Instagram account information or for posts from Instagramaccounts. Public Instagram accounts include professional accounts for businesses andcreators. They also include a subset of personal accounts that have account privacy set topublic and have either a verified badge or 50,000 or more followers. A verified badge in thiscontext refers to accounts confirmed as authentic and not those with a paid Meta Verifiedsubscription.  Instagram accounts data and Guide to Instagram posts data.You can filter posts from Facebook Pages by the page admin’s location country. Set the newadmin_countries parameter to include one or more country codes of your choice. SeeGuide to Facebook posts data.Multimedia (photos and videos) can be included in search post results for both Instagram andFacebook. This feature is only available if you are accessing the API in an approved third partycleanroom environment, and only if that environment supports retrieval of multimedia. Thefeature is not available in Researcher Platform.  Facebook posts data and Guideto Instagram posts data.The citation format was updated with a new Digital Object Identifier (DOI) that specifiesversion 2.0. Older release DOIs are still available for reference. See Citations.Content Library and APIGet accessQuick linksContent LibraryContent Library APIOverviewChangelogGetting startedGuidesAppendixSupportDisclosures and DisclaimersCitationsVersion 1.0 update, December 15 2023The following changes were implemented:Search quality metrics were updated/improved. See Search quality approach.Due to the improved search quality, the "beta" designation on version 1.0 was removed.The citation format was updated with a new Digital Object Identifier (DOI) that does notinclude a beta designation. See Citations.


key: file_path
string_value:
C:\Users\Emile\Documents\Opsci\Code\git\ENOPrompt\data\chatbot_40_12\KB_4012\META\Citations - Content Library and API - Documentazione - Meta for Developers.pdf


