Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Grant application for Boris Boarman #2478

Closed
wants to merge 8 commits into from

Conversation

imboogieman
Copy link

Project Abstract

Please replace these instructions with a brief description of your project summarising key points (1-2 paragraphs).

If your application is a follow-up to a previous grant, please mention which one in the first line of the abstract and include a link to previous pull requests if applicable.

Grant level

  • Level 1: Up to $10,000, 2 approvals
  • Level 2: Up to $30,000, 3 approvals
  • Level 3: Unlimited, 5 approvals (for >$100k: Web3 Foundation Council approval)

Application Checklist

  • The application template has been copied and aptly renamed (project_name.md).
  • I have read the application guidelines.
  • Payment details have been provided (Polkadot AssetHub (USDC & DOT) address in the application and bank details via email, if applicable).
  • I understand that an agreed upon percentage of each milestone will be paid in vested DOT, to the Polkadot address listed in the application.
  • I am aware that, in order to receive a grant, I (and the entity I represent) have to successfully complete a KYC/KYB check.
  • The software delivered for this grant will be released under an open-source license specified in the application.
  • The initial PR contains only one commit (squash and force-push if needed).
  • The grant will only be announced once the first milestone has been accepted (see the announcement guidelines).
  • I prefer the discussion of this application to take place in a private Element/Matrix channel. My username is: @_______:matrix.org (change the homeserver if you use a different one)

@github-actions github-actions bot added the admin-review This application requires a review from an admin. label Dec 25, 2024
Copy link
Contributor

github-actions bot commented Dec 25, 2024

CLA Assistant Lite bot All contributors have signed the CLA ✍️ ✅

@imboogieman
Copy link
Author

I have read and hereby sign the Contributor License Agreement.

Copy link
Contributor

@keeganquigley keeganquigley left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @imboogieman thanks for the application. Could you please rename the file with a .md extension so it is easier to read? Thanks.

@keeganquigley keeganquigley added the changes requested The team needs to clarify a few things first. label Jan 6, 2025
@keeganquigley keeganquigley self-assigned this Jan 6, 2025
1. Added .md extension to the file name for better readability 
2. Updated the naming for better alignment with the project goals.
applications/Boris Boarman. Web3 Grant Coach.md Outdated Show resolved Hide resolved
| **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests.|
| **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone.|
| 0e. | Article | We will publish an article that explains what was done/achieved as part of the grant. |
| 1. | Web App Graphic User Inerface | Main layout (chat, parameters sections, sessions), Problem Statement, Feasibility Plan, Innovation and Differentiation, Impact Potential, Team Profile, Milestones, Timelines, and Budget (Delivery Plan), Documentation download, User profile (registration, settings). |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We only fund technical development, so we likely wouldn't fund some of these initial website setup deliverables. Additionally, we ask for some initial mockups/wireframes to be provided in the application for the front-end parts.

Copy link
Author

@imboogieman imboogieman Jan 20, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@keeganquigley The web application is the GUI for the solution we develop. The UI mockups can be seen here Boris Boarman UI Mockups.

Shared the link in the original application, but it might have be missed. Updated the link in the file as well.

Update the Blockchain Interaction specifications.
Updated UI components mockups link markup for better visibility.
@keeganquigley
Copy link
Contributor

keeganquigley commented Jan 28, 2025

Thanks for the changes @imboogieman I could see this possibly being useful as a widget for grant applications, but personally I think it is too expensive. I'd rather see a level 2 PoC first to determine how feasible the solution is.

Additionally, I'm not sure how we would be able to integrate this into our W3F grants program. For one, we have private grants in addition to public ones, which we wouldn't be able to parse with this tool. But even for the public ones, I think the app would have to be in the form of a GitHub bot or something. Otherwise, the way your current front-end is set up, it doesn't seem any different than using existing AI solutions. Therefore I won't approve it but I will mark it as ready for review to see if anyone else has other comments.

@keeganquigley keeganquigley added ready for review The project is ready to be reviewed by the committee members. and removed changes requested The team needs to clarify a few things first. labels Jan 28, 2025
@imboogieman
Copy link
Author

I could see this possibly being useful as a widget for grant applications.

The first target audience is the applicants, so they can faster write and score their ideas, so the reviewers get less workload. The end goal is provider as a solution for DAO governance as well.

@imboogieman
Copy link
Author

but personally I think it is too expensive.

We estimated both the LLM testing and configuration activities for each of the 7 parameters. We put a detailed estimation. We calculated everything at minimum rates accounting risks and testing the model.

Did you chance to check the spreadsheet with the estimation break-down?

@keeganquigley
Copy link
Contributor

keeganquigley commented Jan 28, 2025

Thanks for your thoughts @imboogieman that's also part of my reason for rejecting it, because I don't believe the committee will want to fund a proposal generator for applicants. Not that AI can't be helpful, but in my opinion teams are overly reliant on it already, and I don't want to pay for them to use it :)

But I will keep the proposal open for a few days for others to comment. Also I don't think the idea is a bad one, I just don't think it should be funded by W3F. Also because it's not super specific to Polkadot.

@imboogieman
Copy link
Author

I'd rather see a level 2 PoC first to determine how feasible the solution is.

It is feasible as we have already developed the prototype with the 3 parameters and basic scoring model. https://boris-boarman-main-app.dep.zsoft.link/

And we are heading to have 7 parameters in total for the next version and more advanced scoring model with a range form 0 to 1000 points for better accuracy.

@keeganquigley
Copy link
Contributor

Did you chance to check the spreadsheet with the estimation break-down?

Thanks @imboogieman no I missed this so I will check it out.

@imboogieman
Copy link
Author

imboogieman commented Jan 28, 2025

This to me doesn't seem any different than using existing AI solutions.

Is it possible to share what solution you meant? As OpenAI and other providers' default LLMs are not proving accurate results when it comes to scoring thus we are using open model just for reasoning. And for numeric scoring we have our own scoring rubric and built-in module.

And even now we are having from 5 to 10 points range variance that is why testing and fine-tuning is a big part of the development to reach more or less accurate results. For the next version we will be using Invest ML, a model specifically trained for investment decision, for now it will overcomplicate the development and increase the cost significantly.

@imboogieman
Copy link
Author

Did you chance to check the spreadsheet with the estimation break-down?

Thanks @imboogieman no I missed this so I will check it out.

The tab "Cost break-down" and "Estimation"

https://docs.google.com/file/d/1n4CuKghjtqOstTCBLnVJDUUf1dkN8EcZ/edit

I checked the estimation for a few times to make it as accurate as possible, though I still think we will go over as there is a lot of unknown. However, this approach, I consider much more transparent and accurate. Also, we want to implement milestone estimation as well, so the development is priced evenly. That is another important feature of the product and AI in this case as estimation takes time and a lot of developers are not able to prologues accurate estimates.

@imboogieman
Copy link
Author

I just don't think it should be funded by W3F.

First, we submitted a proposal for Polkadot Treasury, but a team of reviewers named Lucky Friday recommended us to apply for W3F grants because of the nature of the project.

@imboogieman
Copy link
Author

imboogieman commented Jan 28, 2025

Also because it's not super specific to Polkadot.

As we discovered Polkadot is currently running numerous grant programs for the ecosystem products

https://polkadot.com/blog/the-ultimate-2024-polkadot-grants-and-funding-guide

Our solution also is able to select the most appropriate grant program for an idea or initiative so builder not spend time on searching but focusing on delivery. I'm personally busy now with this recommendation functionality at the moment.

@keeganquigley
Copy link
Contributor

ok thanks for your feedback @imboogieman I'll bring it up for internal discussion in our sync tomorrow morning and ask the rest of the committee to take a look.

@imboogieman
Copy link
Author

ok thanks for your feedback @imboogieman I'll bring it up for internal discussion in our sync tomorrow morning and ask the rest of the committee to take a look.

Hey @keeganquigley ! How is it going? Did you chance to bring other reviewers and get their opinions?

Just to support even more our application, here I want to share some quotes.

"AI can solve this by voting in place of humans. Instead of a human making a voting decision and signing a transaction with their wallet, they can delegate their tokens to an AI agent to vote on behalf of them." - source Aragon blog.

"Once the proposal is created, a DAO can start the voting process once the proposal is submitted. While the voting commences, AI agents can act on behalf of humans." - source "Artificial Intelligence and Decentralized Autonomous Organizations: Where two worlds meet", a blog post of Wipro Tech, Oct 24, 2024

As the next steps we will provide APIs to DAOs so they can integrate this solution into their decision-making process. These two milestones are the first steps to test all the hypothesis and find and fine-tune the best models.

Imagine now it is something small that can grow into a real big and essential thing for the whole web3 community.

@semuelle
Copy link
Member

semuelle commented Feb 3, 2025

Thanks again for the application, @imboogieman, b after careful consideration, the committee decided not to support it. There was mainly concern about the usefulness of an LLM with regard to grant applications and the price tag.

However, we hope this won't deter you and you'll find a way to make your project a reality. Please check our page on alternative funding opportunities. Best of luck!

@semuelle semuelle closed this Feb 3, 2025
@imboogieman
Copy link
Author

Thanks again for the application, @imboogieman, b after careful consideration, the committee decided not to support it. There was mainly concern about the usefulness of an LLM with regard to grant applications and the price tag.

However, we hope this won't deter you and you'll find a way to make your project a reality. Please check our page on alternative funding opportunities. Best of luck!

Hi, Samuel!

Is it possible you can provide a more detailed feedback? As I don't understand what concerns you have as our research shows that even other foundations are repeating our idea https://www.aipgf.com/.

As well as we provided several links to the trusted sources highlighting the problem. As well quotes from trusted founders that such a solution can help DAOs a lot. It is just embarrassing.

As to the price tag? Will you be likely to approve if we shrink the scope to fit the cost under Option 1 for example?

@imboogieman
Copy link
Author

imboogieman commented Feb 3, 2025

Thanks again for the application, @imboogieman, b after careful consideration, the committee decided not to support it. There was mainly concern about the usefulness of an LLM with regard to grant applications and the price tag.

However, we hope this won't deter you and you'll find a way to make your project a reality. Please check our page on alternative funding opportunities. Best of luck!

https://x.com/web3dealdesk

It is easy to steal than to support. This is all about it. Now I understood why it took so long and why you reject the proposal without any clear and logic feedback. So silly. I'm taking this case to the media to let people know who is behind the web3 foundation claiming to build honest and transparent internet. Just another prove that the idea is right to the problem.

@semuelle
Copy link
Member

semuelle commented Feb 3, 2025

Is it possible you can provide a more detailed feedback?

Yes.

  • We have looked into using LLMs for our internal purposes a while ago and found that they were too inaccurate. But even if they weren't, there is so much contextual, ever-changing information beyond the application doc necessary that it would be infeasible to build and maintain a sufficiently accurate model for our purposes at this point.
  • We are not keen on receiving even more LLM-written grant applications, as the parts that LLMs are good in are the least interesting bits of an application and at worst, mask incompetence of the applicant.
  • We prefer to talk to potential applicants directly about funding mechanisms, as it will help us get a better picture of what they need and where they are in their journey.
  • Funding opportunities come and go, so what may have been right six weeks ago might not be right, or even exist, today. Your training data will be outdated before you collected enough.
  • You did not explain what data and functionality the smart contracts would be responsible for, where you would deploy them, or address the fact that most parachains do not support Solidity smart contracts, excluding them from the concept.
  • None of your deliverables even mentions Polkadot or anything related to it. Perhaps this is due to the fact that there is indeed little connection to any blockchain, as evidenced by your earlier applications in other ecosystems.

To conclude: we might have looked at different data, or looked at them through different lenses, just like the organisations that do support similar projects did. I'd be happy to be proven wrong. However, I do not see sufficient "research" in your document that would warrant our conclusion "embarrassing". That being said, you linked to the State of Web3 Grants report three times and called it "provid[ing] several links to trusted sources", so I'm skeptical our ideas of what constitutes research overlap.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
admin-review This application requires a review from an admin. ready for review The project is ready to be reviewed by the committee members.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants