Fabric

FAQ - Researchers

General
What is a Fabric Study?

Our mission at Fabric is to make it easy for people, researchers, and businesses to experience the lives of others from around the world through video. Through Fabric’s DIY option, you (the researcher) can set up your own studies, invite your own audience of participants, and ask those participants questions, getting video answers quickly. 

Read more about Fabric use cases, inspiration, and applications in our Resource Hub.

What's Included?

When you set up, launch, and field a Fabric study, the study includes:

      1. External study naming visible to participants
      2. Option for internal study naming not visible to participants (researchers and collaborators only)
      3. A cloud-based link to your study which can be shared to collaborators with varying levels of viewing permission
      4. Up to 10, one-minute video responses of your questions per participant
      5. Transcripts generated by Google Speech (editable because machines aren’t perfect at matching video responses yet)
      6. Matrix view of video responses and transcripts to allow for organized analysis
      7. In-platform organizational and analysis tools such as tagging, commenting, rating
      8. Option to download videos (720P, .mov format)
      9. Option to download transcripts (exported to Excel file)
      10. Option to distribute incentives via PayPal within 24 hours of study completion
      11. Shareable links to individual responses or the entire study
What is the process?

As a researcher, you can start building studies through the Fabric study builder once you’ve created a researcher account. Click here to sign up or log in as a Fabric researcher.

Within your Fabric researcher account, you will have access to a dashboard where you can create and manage your studies from study design (# of participants, survey question input, email invitations, etc.), managing and viewing responses, analyzing responses, to account and billing.

Incentive amounts greater than $0 are included in the total study payment billable to you (the researcher), but Fabric will distribute incentive payments greater than $0 to participants through PayPal as they submit their video responses to the study (once the study has been paid for and launched). If a participant completes the survey and doesn’t have a PayPal account associated with the email address you’ve invited into the Fabric video survey, the participant will still receive an email notification from PayPal regarding their payment and how to access the money.

Who's who?

Throughout your experience with Fabric, you’ll see the following names for different roles in a Fabric study:

      1. Researcher: If you are reading these FAQs, you are likely the Researcher! The researcher is the person who is utilizing Fabric as a research tool by creating a study, collecting video responses, and analyzing video responses through the Fabric platform.
      2. Participant: Participants are the people that provide their opinions by participating in a Fabric video survey. After the researcher sets up a Fabric study, they will invite their pre-qualified participants to the study and collect video responses to the study questions.
      3. Collaborator: A collaborator is someone on the researcher’s team who can have viewing access to the study assets (videos, transcripts within the response matrix) through Fabric’s sharing capabilities. Collaborators do not have access to study settings that the researcher has specified in the Fabric study builder.
What languages are available?

Studies are created and conducted in English only for the time being, primarily because our app onboarding and instructions are in English only.

We have run Spanish language studies in the US, and foreign language studies in Europe, Asia, Latin American and Africa. For help with non English speaking studies and/or foreign language studies, contact us at sales@fabric.is

Is Fabric DIY right for me?

Fabric DIY is perfect for researchers who want to be hands on and have control over their research process.

If you are curious about additional research support options with recruitment, study design, analysis, etc. please contact us at sales@fabric.is.

Additionally, the Fabric Resource Hub has content around research design and analysis recommendations, as well as inspiration for Fabric applications and use cases.

Designing Your Study
What should I name my study?

Title: The title is the name of your study that will also be visible to your participants. The one thing to keep in mind when titling your study is how much of a hint you want the study name to have – or not – for participants.

For example, if it’s a brand blind study, a generic name should be used (e.g. Car Study). If, however, you want to be more overt about the study topic and/or the company behind it, make the study title more obvious (e.g. Toyota Corolla Owners Study).

Internal title: An internal title is optional and will only be visible to you and your collaborators. Participants will not see this internal title.

How many participants should I specify for my study?

Sample sizes depend on a lot of variables, and there are a few ways to look at it:

      1. Fabric studies are qualitative in nature. Academics will argue that with qualitative sample sizes, you should aim for the point of saturation, meaning the point at which adding one more respondent to the study will yield no additional insight.
      2. General industry guidelines suggest a sample size of 30 people is the saturation point. Some earlier stage studies are smaller, and earlier stage innovation can be fueled directionally by smaller sample sizes to test the waters. Large companies tend to prefer larger sample sizes to smaller, and depending on company cultures, stakeholders may value larger sample sizes (50+).
      3. Generative research studies (meaning you are using the study to generate ideas and insight) tend to be smaller sample sizes than Evaluative research (where you are asking respondents to evaluate an idea/concept).

Our system will only accept completions from the quota you assign – so if you specify your quota as 30 participants, but invite more than 30 participants, our system will stop collecting responses once your study has reached 30 participant completions, unless the quota is amended.

How should I set study dates?

The default for studies is that they are opened for respondents once payment has been processed, and the study will be closed once quota – or the end date – has been reached. Otherwise, you can specify custom start and end dates for studies within the study builder:

Start Date: Set this date for when you’d like to the study to be open and accessible to your invited participants. Note that your payment must also be processed in order to collect video responses from your invited participants.

End Date: Set this date for when you’d like the study to close and stop collecting responses. Note that your study will automatically close on this end date, or once your quota has been reached (whichever comes first).

You can also manually open and close your study later if needed, outside of your specified date range.

When we manage studies for clients, we typically allow up to 7 days to complete US studies, and 14 days for international studies. However, quotas are often filled in a matter of days – sometimes even within hours.

What amount should the incentive be?
As for incentives, we believe consumers should be compensated well for their time and effort. In our experience, when you are generous with them (regarding compensation), they are generous and responsive in return.
As a result, we typically pay $5/question incentive compensation in our full service studies, but there are a few reasons you may consider offering a higher incentive rate:
      1. Time constraints: You are under a tight timeline and need people to submit their video responses quickly, so a higher incentive may encourage quicker participation.
      2. Additional tasks: You want to prompt your participants to record special tasks within the study (for example, recording responses from a specific location, at a specific time of day, etc.). A higher incentive can encourage participants to set aside the time and effort required to follow your specific tasks.
      3. Special Audiences: Subject matter experts, wealthier consumer targets, and certain recruits may inherently require a higher incentive rate to incentivize them to participate and make their time and participation worthwhile.
Based on your specified quota, the study builder will calculate and quote your billable incentives total for the study. (Specified quota * specified incentive amount per participant = study total incentive).
How to write great study questions?

There is a limit of ten study questions. Each question will prompt the participant to provide a 60 second self-recorded video response. Therefore, if you set up 10 study questions, you will receive ten, 60 second self recorded video responses per participant once they complete the task.

Study questions have a limit of 400 characters.

Here are some links to great resources for asking effective study questions:

      1. Pro Tips – Study Questions
      2. Pro Tips – Methodologies
What formatting options are available to me when writing my study questions?

You may bold, italicize and/or underline text in questions. Study questions have a limit of 400 characters.

You may also include links to other sites or cloud destinations (Box, DropBox, Google Drive etc) in order to expose consumers to additional materials.

How can I add external stimuli to a study question?

If you want to add stimulus to a study question, input your question text into the study builder. Participants should be prompted to open the link in the question wording (e.g. “Click on the following link”). Highlight the word(s) you want consumers click on, and add a hyperlinked URL destination.

For example, if you want to present stimulus within a study question, you can write: “Click here to review materials.After reviewing the materials, describe your initial reactions.What did you like and / or dislike about the materials ?” Make sure to highlight the words “Click here to review materials, ” click the hyperlink option, and set your hyperlink to whatever material you’d like participants to review for that study question.

When respondents click on embedded links, a pop up within our mobile app (or a new browser window) will open. After respondents view the stimulus, they will close the pop up or window and record their video response to the study question.

      1. You can host your materials on a drive that offers password protection (like Google Drive, DropBox, etc.)
      2. Or, you can host your materials on a drive or system that does not require password protection
      3. Media from your desktop or local drive cannot be linked – links must be hosted and exist in the form of a functioning hyperlink/URL.

If you’d like to continue asking multiple study questions about a single stimulus hyperlink, we recommend providing the hyperlink again in subsequent questions so that participants can access and review the stimuli for each relevant question. For example, “If you disliked anything in the materials you saw in the previous question, how would you change them? What aspects, language, imagery, etc. would you change specifically? If you need to review the materials again, click here”

What if I want to make changes to my study question content?

You will have the opportunity to preview (including editing and/or deleting) study questions before officially launching your study.

Study questions can also be revised once a study is in progress – however, if you want to change your study questions after you’ve collected any video responses on that study, you will need to keep a separate record of the previous study question version in your own files. Previous versions of study questions are not kept within our platform after you make changes.

If you proceed with any changes to study questions after video responses have been collected, we recommend tagging those participants who have already completed their studies with the appropriate question version that corresponds to your question version labels in your files, so you know which respondent has answered which question set (i.e. tag participant one with a “Question set v1” label, “Question set v2,” etc.).

How many people should I invite to participate?

Our general rule of thumb is 10x the desired quota to begin with, to account for realistic response rates (very rarely will you receive a 100% response/participation rate). If you want 25 respondents to complete, invite 250 to begin with.

You may find that response rates vary depending on various factors:

      1. Friends and family vs general marketing email list
      2. Audience criteria (i.e. different response rates depending on different age ranges, genders, etc.)
      3. Timing between your recruiting efforts and when you build your Fabric study and send email invitations

The study will close once the quota is achieved, so you have that safeguard.

In terms of inviting respondents, they can be added one at a time separated by a comma, or added by uploading a CSV file.

Formatting for the CSV file should include a full email address.

The upper limit for number of invitee email addresses is 1,000.

How should I write my invitation email?

You can customize the copy that will be emailed to your invited participants.

Sender: Note that the sender on these email invitations will be “no-reply@fabric.is” therefore, you may want to pre-emptively communicate to your participants that they should expect an email invitation from “no-reply@fabric.is,” and to check their spam folder if they can’t find it (once you’ve launched the study and invites have been sent out).

Subject: You can customize the subject line for the invitation email. We recommend utilizing this customization to present a subject line that will stick out to your participants in their email inboxes. For example “[INVITATION FROM SARAH C] $50 mindswarms Video Survey” may be easier for participants to find and notice than a subject like “video survey.”

Message: The invitation email message is an opportunity for added communication between your recruiting process and the platform. Outside of your study questions, there will be minimal detail/instruction within the platform once your participant enters the study from the link provided in the email invitation. Therefore, you may want to add any detail around special tasks required (i.e. “make sure you are at home when you access the study,” or “we will be asking you questions about your car,” or “please complete the study at dinnertime tonight,” etc.) in the customized email invitation.

All of your participants will receive this customized email invitation once you launch the study. The email will also populate with the link to the study itself.

How can I preview my study?

As you walk through the study builder in your initial study set up, you will have an opportunity to review your study definitions (Study title, Internal title, Study dates, Participants count, Incentive), content (Questions), and participant information (# of participants to invite, customized email content) on a single page overview. You can edit these any of these fields before you launch the study.

Once you have agreed to the Terms & Conditions, processed payment, and launched your study, your study will be active and participants will be invited via email with the customized email copy you set within the study builder. If you need to make any changes to your study settings after launching the project, you can do so by navigating to the dashboard, finding your study card, and then clicking the three dots on the study card to “edit.”

What does it mean when my study is a “draft?”

For studies that you have started building, but haven’t launched yet, you can exit Fabric and return later for further edits. The study builder will auto save your progress every 10 seconds. When you return to Fabric to continue building your study, your study will appear on your dashboard as a card labeled as “draft” status. You can continue editing your draft study by clicking the three dots on the study card and going to “edit.” Clicking on the card itself will take you to the response matrix (which will remain empty until you launch your study and participants submit their video responses).

What’s included in the study cost?

The estimate for the study cost is derived from how many participants you are inviting and the incentive you plan to pay them.

A study includes:

      1. A cloud-based link to your study, which hosts your study assets for 3 months
      2. Up to ten one minute video answers of your questions
      3. Transcripts generated by Google Speech (editable because machines aren’t perfect at matching video responses yet)
      4. Option to download videos
      5. Option to download transcripts
      6. Shareable links to individual responses or the entire study
      7. Taxes where applicable
What does it mean when my study is “active?”

Once you have built your study through the study builder, agreed to the terms & conditions, processed payment, and launched your study, your participants will be invited via email with the customized email copy you set within the study builder and your study will be set to “active.” This means that your invited participants can submit their video responses through the platform by accessing the link within their email invitations, as long as your quota of completes has not been met or the end date you set for the study has not expired.

When you return to Fabric to access your active study, your study will appear on your dashboard as a card labeled as “active” status. You can navigate to the study preview and settings by clicking the three dots on the study card and going to “edit.” Clicking on the card itself will take you to the response matrix (which will house any video responses that your invited participants have submitted).

Managing Your Responses
What happens after I’ve built and launched my study?

Once you have built your study through the study builder, agreed to the terms & conditions, processed payment, and launched your study, your participants will be invited via email with the customized email copy you set within the study builder and your study will be set to “active.” This means that your invited participants can submit their video responses through the platform by accessing the link within their email invitations.

When you return to Fabric to access your active study, your study will appear on your dashboard as a card labeled as “active” status. You can navigate to the study preview and settings by clicking the three dots on the study card and navigating to “edit.” Clicking on the card itself will take you to the response matrix (which will house any video responses that your invited participants have submitted).

What is the response matrix?

When you access your response matrix, you will see video responses organized and presented in a matrix/table format, with your study questions across the top and respondents down the side.

Participants’ video responses are presented in rows, and each participant row is labeled in the leftmost column of the matrix with that participant’s email address, star rating (based on how you rate them if you decide to utilize this feature), an “Add Name” field for custom name or label (in case the email address doesn’t make it obvious that, say, dogtownskater98 is actually John Smith), and the status of whether the invited participant has opened the link or completed the study (e.g. submitted a video response for each study question).

Study questions are presented in columns, and each question column is labeled in the topmost row of the matrix with the most recent question text you’ve set for the study. Any hyperlinks embedded within study questions are also accessible on the matrix.

When you click on a single video within the matrix, a player for that particular video will pop up with additional options (including tagging, rating, commenting, filtering, and sorting) for interacting with that video in particular. 

Preview our response matrix and get to know the platform here, via a sample study.

What happens if nobody responds to my study?

Because we have no control over the quality of external email addresses, Fabric is not responsible for drop off / unresponsive invited participants. Based on our experience managing our own studies, we have some recommendations for proactively accounting for response rates.

When you are setting up your study and preparing your email invites, our general rule of thumb is to invite 10x the desired quota to begin with, to account for realistic response rates (very rarely will you receive a 100% response/participation rate). If you want 25 respondents to complete, invite 250 to begin with.

You may find that response rates vary depending on various factors:

      1. Friends and family vs general marketing email list
      2. Audience criteria (i.e. different response rates depending on different age ranges, genders, etc.)
      3. Timing between your recruiting efforts and when you build your Fabric study and send email invitations

The study will close once quota is achieved, so you have that safeguard.

The upper limit for number of invitee email addresses is 1,000.

Why should I “hide” responses?

If you receive video responses that you want to omit from the matrix, you can do so by using the “hide” feature. Note that even if you hide a response, you will need to pay for this participant’s completion of the study and their distributed incentive.

If you receive video responses from a participant that are not acceptable and you want them to re-record, you have the opportunity to submit a support ticket within the response matrix, requesting Fabric to notify a participant if their video response(s) are not acceptable.

What if I want someone to re-record/re-do their video response(s)?

You have an opportunity to submit a support ticket within the response matrix, requesting Fabric to notify a participant if their video response(s) are not acceptable and provide the participant with a link to re-record their video response(s). These support requests will be reviewed by the Fabric team and processed as follows.

Note that participants will receive their incentive payment 24 hours after they submit their videos. Video responses should be checked before the 24 hour time period has elapsed, so that any support ticket and subsequent action can be communicated to the participant and/or researcher before the participant receives their incentive payment. If the 24 hour time period has already passed, the participant will have received their incentive and is unlikely to re-record videos at that point. Issuing a support ticket before 24 hours will freeze respondents’ payment until their issue is resolved (e.g., you asked them to show their pantry on camera and they did not).

Valid reasons for requesting a participant to re-record through a support ticket include:

      1. Poor audio: You cannot hear the participant’s audio or there is too much background noise that is interfering with the volume of their response.
      2. Poor video: The participant has failed to frame their face and/or is not visible within the frame of the video.
      3. Incomplete: The participant has not completed the tasks prompted in the study questions.

You may submit a support ticket request in the context of a singular video response or all of the participant’s video responses.

If you submit a support ticket request for a participant, provide some detail around your reasoning and it will be reviewed against the participant’s video(s). The Fabric team will either submit the notification to the participant and prompt the participant for a re-record, or provide a different recommendation to the researcher if the support ticket reasoning is determined invalid.

What if I want a participant to re-record a video?

If a participant submitted video(s) that have poor audio, poor video, or ara incomplete, you may prompt the participant to re-record their video(s) through the support ticket mechanism.

We recommend being mindful of the participants’ efforts when it comes to requesting re-records. Please see our suggestions on writing effective study questions to set your study up for success and avoid needing re-records.

What if the videos appear sideways or upside down?

You can rotate individual videos by clicking on the video, and within the box for that particular video pops up, there is an option to “Rotate” above the video player. Clicking on “Rotate” will provide a dropdown menu with options to rotate 0°, 90°, 180°, or 270°.

How do I share the video responses with collaborators?

You can share individual videos with collaborators. When you click on the video, within the box for that particular video, there is an option to “Share” above the video player. This will copy a link to your clipboard that you can share with collaborators outside of the platform (they do not have to log into a Fabric account in order to access this link and view the video you’ve shared).

You can also share a full response matrix with collaborators by navigating to the matrix view, then clicking the three dots in the right hand corner of the matrix, which will provide a dropdown menu with the option to “Share.” You can enter your collaborators’ email addresses and a message, which will send them an email notification with access to view the response matrix.

Sharing videos and response matrices will not give collaborators access to edit any of your study settings, but they can view your study assets and comment within the platform.

Analyzing Your Responses
How can I use Fabric to analyze my responses?

Once you’ve collected video responses to your Fabric study, there are tools within the Fabric platform (in the response matrix) that can assist your analysis process such as tagging, rating, commenting, filtering, and sorting.

The layout of the response matrix itself is designed to set you, the researcher, up for the most success when it comes to reviewing, synthesizing, and analyzing the content from your collected video responses. The grid format organizes video content into easy-to-digest 1-minute video clips based on participant and study question, making it easy to locate the topic and/or participant whose video response you’d like to interact with.

Additionally, Google speech transcripts provide a searchable text format of the collected video content.

You may download transcripts and individual videos off of the Fabric response matrix if you’d like to store them within your own files, or use the content in video editing, presentations, etc.

How do I access transcripts?

When you navigate to your study’s response matrix, the default view shows the video responses in the matrix format. At the top right hand side of the response matrix is an option where you can click to toggle between “Show Transcripts” and back to the default, “Show Videos.”

“Show Transcripts” toggles to Google Speech transcripts in the response matrix view instead of the video responses.

Transcripts are generated by Google Speech (editable because machines aren’t perfect at matching video responses yet).

What is a “tag?”

When you click on an individual video response, within the box for that particular video, there is an option to “Add Tag” underneath the video player. These tags work like hashtags, where you can label the video response with shorthand notes that will be helpful to you in organizing and finding those specific video responses based on topic, or any category you decide. Some examples:

      1. You can tag a video response as “positive” if the participant responded positively to the study question
      2. You can tag a video response as “brand usage” if the participant was recruited as a “brand user” by your definition and is talking about why they use that brand
      3. You can tag a video response as “organized kitchen” if you asked the participant to show you their kitchen and their recording shows a particularly organized space

Tags are meant to be customized for your use as a researcher, to help you organize your video responses and content.

What are the star ratings for?

Star ratings are optional but can help you label participants based on their overall response quality. That way, you can rate participants and have a birds eye view on:

      1. Higher-rated participants that provide particularly articulate, insightful responses that you may want to prioritize in your analysis, versus
      2. Lower-rated participants that were perhaps less thorough in their responses, had lower video quality, etc. that are deprioritized in your analysis.

Star ratings are based on your criteria and participants will not have visibility to the way you’ve rated them on the response matrix. Collaborators will have visibility to star ratings on the response matrix.

Where can I make notes or comments?

When you click on an individual video response, within the box for that particular video, there is an option add comments on that individual video response. This can be helpful to bookmark some thoughts you have about that video response that you can revisit later. Comments can be used for more long-hand thoughts than tags.

Participants will not have visibility to the comments you’ve added to their videos. Collaborators will have visibility to comments on the response matrix.

How do I utilize the “filter” function?

At the top right hand side of the response matrix is an option where you can click to filter responses based on the options provided in the dropdown menu:

      1. All: This is the default setting which will present all video responses and rows for your invited participants.
      2. Name: This filter setting will present the participant rows in alphabetical order based on their email address.
      3. Date: This filter setting will present the participant rows in chronological order based on the date and time that they submitted their videos.
      4. Rating: If you’ve rated participants on the response matrix, this filter setting will present the participant rows in order based on their star ratings.
      5. Status: This filter setting will present the participant rows based on their completion status (whether they’ve opened the invitation link but haven’t submitted all video responses, or if they’ve completed all video responses).
How do I utilize the “sort” function?

At the top right hand side of the response matrix is an option where you can click to sort responses based on the options provided in the dropdown menu:

      1. None: This is the default setting which will present all video responses and rows for your invited participants.
      2. Ascending: Setting the sort function to “ascending” will present the participant rows in alphabetical order based on their email address (A at the top → Z at the bottom).
      3. Descending: Setting the sort function to “descending” will present the participant rows in alphabetical order based on their email address (Z at the top → A at the bottom).
What if I need additional analysis support?

If you are curious about additional analysis support options, please contact us at sales@fabric.is.

Additionally, the Fabric Resource Hub has content around research design and analysis recommendations, as well as inspiration for Fabric applications and use cases.

Account & Billing
What if my company requires a PO or additional paperwork?

Contact us for help: email finance@fabric.is.

What if my company doesn’t permit the use of credit cards for sponsoring research studies?

Contact us for help: sales@fabric.is.

What if I need to cancel my study but I’ve already paid?

If you have drafted a study but you haven’t submitted payment yet, you will not be billed. If you have already paid for and launched your study, you may cancel your study at $250 minimum fee until 7 days after payment.

Privacy & Legal

Please click here to read our full terms and conditions for researchers and here for our privacy policy.

Subscribe to our newsletter
Get notified about the updates, latest news and studies.

Thanks for your interest!

Discover the speed and power of Fabric’s AI and easy to use platform below, featuring a real study conducted by 3 PhDs at MSFT in 2021!