embedded machine learning research engineer - georgist - urbanist - environmentalist

  • 0 Posts
  • 16 Comments
Joined 1 year ago
cake
Cake day: June 22nd, 2023

help-circle
  • The raison d’être for RISC-V is domain-specific architecture. Currently, computational demands are growing exponentially (especially with AI), but Moore’s Law is ending, which means we can no longer meet our computational demands by scaling single-core speed on general-purpose CPUs. Instead, we are needing to create custom architectures for handling particular computational loads to eke out more performance. Things like NPUs, TPUs, etc.

    The trouble is designing and producing these domain-specific architectures is expensive af, especially given the closed-source nature of computer hardware at the moment. And all that time, effort, and money just to produce a niche chip used for a niche application? The economics don’t economic.

    But with an open ISA like RISC-V, it’s both possible and legal to do things like create an open-source chip design and put it on GitHub. In fact, several of those exist already. This significantly lowers the costs of designing domain-specific architectures, as you can now just fork an existing chip and make some domain-specific modifications/additions. A great example of this is PERCIVAL: Open-Source Posit RISC-V Core with Quire Capability. You could clone their repo and spin up their custom RISC-V posit chip on an FPGA today if you wanted to.



  • Sounds similar to some of the research my sister has done in her PhD so far. As I understand, she had a bunch of snapshots of proteins from a cryo electron microscope, but these snapshots are 2D. She used ML to construct 3D shapes of different types of proteins. And finding the shape of a protein is important because the shape defines the function. It’s crazy stuff that would be ludicrously difficult and time-consuming to try to do manually.


  • Back when I was in my first year of uni, I applied for a part-time job on indeed. Found out it was a scam when they wanted to pre-pay me with a too-big check and have me transfer the difference to some other account. I noped right out of there.

    For those who might be unaware, the scam is they send you a fraudulent check, but it might take a few days to be discovered as such by your bank. But in the meantime, the amount shows up in your account and you transfer the money they tell you to (which is a legitimate transfer). Then, when the bank discovers the check was fraudulent, they remove the amount from your account, but you’re left high and dry because you can’t undo the transfer because the transfer you did was legit.




  • I moved from California to Montreal a few years back to study, and now I’m staying for good. I tried duolingo on and off for far too long, but I found it super uninteresting and hard to remain committed to.

    Best strategy I’ve found is called comprehensible input. The idea is to find books or other reading material that you can get the basic gist of when reading, despite not understanding every single word and phrase and grammatical construction. The more you read, the more you’ll find yourself able to understand, which is also very motivsting!

    Also, make sure it’s material that actually interests you. The idea is it’s better to read extensively, reading things that actually interest you to some degree and keep you mentally engaged, than to just really intensively study a much smaller amount of (less interesting) material.

    This actually mirrors how we acquire languge. The idea is to intuitively understand French by having seen a lot of it rather than to basically memorize French. You ultimately want to be able to glance at a sign, for instance, and just know what it means without having to translate in your head.

    Some resources I found useful were these French illustrated books in Dollarama, but even better is a series of books designed to be comprehensible input by Olly Richards. He’s a native English speaker and polyglot who has written a bunch of graded readers that gradually increase in vocabulary and difficulty. He has several books for French, including beginner short stories, intermediate short stories, beginner conversations, intermediate conversations, climate change, WW2, and philosophy. The nice thing is he actually does a good job of making the stories and content interesting to an adult learner, unlike the children’s books at Dollarama.

    Even his beginner books might be a little too advanced for your level so far, though, from what you say. If they are, it’d be best to find some material at a lower level that you can understand a little better. After all, if it’s too hard for you, it will make the process much slower and less enjoyable, which will make it much more likely that you quit. You could even simply try googling “french comprehensible input” to try to find material suitable for your level.

    One last resource is the government of Quebec offers free in-person courses for immigrants and many French learners. They are part-time, and they offer multiple options for hours per week, so you could pick what works best for you. It would be worth checking to see if you might qualify for those courses once you move here.


  • They don’t just look like diamond; chemically they’re extremely similar, too. Diamond is just a bunch of carbon atoms covalently bonded together into a 3D crystal, which is why they’re so incredibly hard. Moissanite is basically the same but it’s carbon and silicon atoms mixed together. Silicon has the same number of valence electrons, so it can function similarly chemically as carbon, hence why it works. Thus, moissanite is also extremely hard and refracts light in beautiful ways, too, except imo even more beautifully. Instead of a colorless luster, it’s a subtle rainbow luster to moissanite.

    Source: I got my fiancée a moissanite ring, and it’s lovely. And because it’s lab-made, I got her blue moissanite (the coloring is just from adding certain impurities) that matches our cat’s eyes perfectly. It’s way more unique, cheaper, and more ethical than diamond, but doesn’t sacrifice on quality one bit.









  • Present Day

    Okay, so that’s enough about the past. What about now?

    Well, monopolization of land and housing via the housing crisis has done tremendous harm:

    In 2015, two talented professors, Enrico Moretti at Berkeley and Chang-Tai Hsieh at Chicago Booth, decided to estimate the effect of shortage of housing on US productivity. They concluded that lack of housing had impaired US GDP by between 9.5 per cent and 13.5 per cent.

    In a follow-up paper, based on surveying 220 metropolitan areas, they revised the figure upwards – claiming that housing constraints lowered aggregate US growth by more than 50 per cent between 1964 and 2009. In other words, they estimate that the US economy would have been 74 per cent larger in 2009, if enough housing had been built in the right places.

    How does that damage happen? It’s simple. The parts of the country with the highest productivity, like New York and San Francisco, also had stringent restrictions on building more homes. That limited the number of homes and workers who could move to the best job opportunities; it limited their output and the growth of the companies who would have employed them. Plus, the same restrictions meant that it was more expensive to run an office or open a factory, because the land and buildings cost more.

    And that is just one form of rent-seeking. Imagine the collective toll of externalities (e.g., the climate crisis), monopolistic/oligopolistic markets such as energy and communications, monopolization of valuable intellectual property, etc.

    So I would tend to say that — unless we change our policies to eliminate the housing crisis, properly price in externalities, eliminate monopolies, encourage the growth of free and open IP (e.g., free and open-source software, open research, etc.), and provide critical public goods/services such as healthcare and education and public transit — we are on a trajectory for AI to be Gilded Age 2: Electric Boogaloo. AI merely represents yet another source of productivity growth, and its economic spoils will continue to be captured by the already-wealthy.

    I say this as someone who works as an AI and machine learning research engineer: AI alone will not fix our problems; it must be paired with major policy reform so that the economic spoils of progress are felt by all, not just the rich.

    Joseph Stiglitz, in the same essay I referred to earlier, has this to say:

    My analysis of market models suggests that there is no inherent reason that there should be the high level of inequality that is observed in the United States and many other advanced countries. It is not a necessary feature of the market economy. It is politics in the 21st century, not capitalism, which is at fault. Market and political forces have, of course, always been interwined. Especially in America, where our politics is so money-driven, economic inequalities translate into political inequality.

    There is nevertheless considerable hope. For if the growth of inequality was largely the result of inexorable economic laws, public policy could do little more than lean against the wind. But if the growth of inequality is the result of public policy, a change in those policies could lead to an economy with less inequality, and even stronger growth.


  • Exactly. I work in AI (although not the LLM kind, just applying smaller computer vision models), and my belief is that AI can be a great liberator for humanity if we have the right political and economic apparatus. The question is what that apparatus is. Some will say it’s an inherent feature of capitalism, but that’s not terribly specific, nor does it explain the relatively high wealth equality that existed briefly during the middle of the 20th century in America. I think some historical context is important here.

    Historical Precedent

    During the Industrial Revolution, we had an unprecedented growth in average labor productivity due to automation. From a naïve perspective, we might expect increasing labor productivity to result in improved quality of life and less working hours. I.e., the spoils of that productivity being felt by all.

    But what we saw instead was the workers lived in squalor and abject poverty, while the mega-rich captured those productivity gains and became stupidly wealthy.

    Many people at the time took note of this and sought to answer this question: why, in an era over greater-than-ever labor productivity, is there still so much poverty? Clearly all that extra wealth is going somewhere, and if it’s not going to the working class, then it’s evidently going to the top.

    One economist and philosopher, Henry George, wrote a book exploring this very question, Progress and Poverty. His answer, in short, was rent-seeking:

    Rent-seeking is the act of growing one’s existing wealth by manipulating the social or political environment without creating new wealth.[1] Rent-seeking activities have negative effects on the rest of society. They result in reduced economic efficiency through misallocation of resources, reduced wealth creation, lost government revenue, heightened income inequality,[2] risk of growing political bribery, and potential national decline.

    Rent-seeking takes many forms. To list a few examples:

    • Land speculation
    • Monopolization of finite natural resources (e.g., oil, minerals)
    • Offloading negative externalities (e.g., pollution)
    • Monopolization of intellectual property
    • Regulatory capture
    • Monopolistic or oligopolistic control of entire markets

    George’s argument, essentially, was that the privatization of the economic rents borne of god-given things — be it land, minerals, or ideas — allowed the rich and powerful to extract all that new wealth and funnel it into their own portfolios. George was not the only one to blame these factors as the primary drivers of sky-high inequality; Nobel-prize winning economist Joseph Stiglitz has stated:

    Specifically, I suggest that much of the increase in inequality is associated with the growth in rents — including land and exploitation rents (e.g., arising from monopoly power and political influence).

    George’s proposed remedies were a series of taxes and reforms to return the economic rents of those god-given things to society at large. These include:

    Land value taxes are generally favored by economists as they do not cause economic inefficiency, and reduce inequality.[2] A land value tax is a progressive tax, in that the tax burden falls on land owners, because land ownership is correlated with wealth and income.[3][4] The land value tax has been referred to as “the perfect tax” and the economic efficiency of a land value tax has been accepted since the eighteenth century.

    A Pigouvian tax (also spelled Pigovian tax) is a tax on any market activity that generates negative externalities (i.e., external costs incurred by the producer that are not included in the market price). The tax is normally set by the government to correct an undesirable or inefficient market outcome (a market failure) and does so by being set equal to the external marginal cost of the negative externalities. In the presence of negative externalities, social cost includes private cost and external cost caused by negative externalities. This means the social cost of a market activity is not covered by the private cost of the activity. In such a case, the market outcome is not efficient and may lead to over-consumption of the product.[1] Often-cited examples of negative externalities are environmental pollution and increased public healthcare costs associated with tobacco and sugary drink consumption.[2]

    Severance taxes are taxes imposed on the removal of natural resources within a taxing jurisdiction. Severance taxes are most commonly imposed in oil producing states within the United States. Resources that typically incur severance taxes when extracted include oil, natural gas, coal, uranium, and timber. Some jurisdictions use other terms like gross production tax.

    such as in the Norwegian model:

    The key to Norway’s success in oil exploitation has been the special regime of ownership rights which apply to extraction: the severance tax takes most of those rents, meaning that the people of Norway are the primary beneficiaries of the country’s petroleum wealth. Instead of privatizing the resource rents provided by access to oil, companies make their returns off of the extraction and transportation of the oil, incentivizing them to develop the most efficient technologies and processes rather than simply collecting the resource rents. Exploration and development is subsidized by the Norwegian government in order to maximize the amount of resource rents that can be taxed by the state, while also promoting a highly competitive environment free of the corruption and stagnation that afflicts state-controlled oil companies.

    • Intellectual property reform, e.g., abolishing patents and instead subsidizing open R&D, similar to a Pigouvian anti-tax (research has positive externalities) or Norway’s subsidization of oil exploration
    • Implementation of a citizen’s dividend or universal basic income, e.g., the Alaska permanent fund or carbon tax-and-dividend:

    Citizen’s dividend is a proposed policy based upon the Georgist principle that the natural world is the common property of all people. It is proposed that all citizens receive regular payments (dividends) from revenue raised by leasing or taxing the monopoly of valuable land and other natural resources.

    This concept is a form of universal basic income (UBI), where the citizen’s dividend depends upon the value of natural resources or what could be titled as common goods like location values, seignorage, the electromagnetic spectrum, the industrial use of air (CO2 production), etc.[4]

    In 1977, Joseph Stiglitz showed that under certain conditions, beneficial investments in public goods will increase aggregate land rents by at least as much as the investments’ cost.[1] This proposition was dubbed the “Henry George theorem”, as it characterizes a situation where Henry George’s ‘single tax’ on land values, is not only efficient, it is also the only tax necessary to finance public expenditures.[2] Henry George had famously advocated for the replacement of all other taxes with a land value tax, arguing that as the location value of land was improved by public works, its economic rent was the most logical source of public revenue.[3]

    Subsequent studies generalized the principle and found that the theorem holds even after relaxing assumptions.[4] Studies indicate that even existing land prices, which are depressed due to the existing burden of taxation on labor and investment, are great enough to replace taxes at all levels of government.[5][6][7]

    (continued)


  • Our cities would be compact, walkable, jam-packed with quality transit, and nearly car-free. Cargo would be transported with cargo ebikes, barges along rivers and canals, local freight rail, and cargo trams. People would move by foot and bike and trams and metro and high-speed rail.

    The surrounding countryside would be home to ecological, sustainable smallholder agriculture, preferably with plenty of technology for efficient precision agriculture. Instead of massive monocultures of corn, we’d have diverse polycultures of dozens of different crops, both annuals and perennials.

    Nature would be abundant, protected, and rewilded. We would remove most roads into wild areas and replace with trains and velomobile trails, which would be much lower impact on wild habitats. Every city would have easy, rapid transit access to natural areas by rail, so anyone can go hiking or exploring or whatever they like.

    Our economy would be centered around productivity, not rent-seeking and speculation. We would use policy to reduce barriers to entry to create highly competitive markets. We would heavily tax externalities like carbon emissions and fertilizer runoff and PFAS contamination.

    We would tax people on what they take, not what they make. Income taxes? Nah, you did the labor; that value should belong to you. Carbon emissions? That materially harms others so you should pay tax on that. Hoarding valuable god-given land? You didn’t make it, so you should pay taxes on the land you deprive from the rest of humanity.

    Our democracy would be reformed with a much better voting system like mixed-member proportional representation (MMPR) or single transferrable vote (STV), so we could have healthy multiparty systems.

    Our society would publicly invest more in research and development, open-source projects, infrastructure, and anything else that generates positive externalities. You rewilded 100 acres of native grassland? Society should pay you for your valuable labor.

    The balance of power between labor and employers would be balanced. A citizen’s dividend or universal basic income, subsidies on positive externalities (like rewilding), and the economic general growth spurred by elimination of rent-seeking would allow for an empowered working class that could capture its own productivity gains, demand better pay, and demand shorter hours. Much like how the professional class can demand good pay and good working conditions currently.

    In short, the economy would be centered around Georgist principles, environment and agriculture around permaculture, and democracy around technocratic and representative democracy. A shared, sustainable prosperity for all.