# DeveloPassion's Newsletter 175 - Flux 1 ## Welcome Another week, another newsletter! I hope that you all had a great one 🤩 Hello there! This week has been really fun. My kids are at home for the last week of vacation, so there wasn't much time for me to work on the [Knowledge Management course](https://www.store.dsebastien.net//product/knowledge-management-for-beginners), but I've used the little time I had to write, and explore cutting-edge AI image generation models. And woah, I'm super impressed, and I want to tell you more about it. Put your seatbelt on! Alright, let's gooooo 🚀 ## The lab **🧪** Since my work time was very limited, I've decided to do some R&D work. A while ago, I heard about [FLUX.1](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/FLUX.1), the new [AI image generation model](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/AI+image+generation+models) of Black Forest Labs, and wanted to give it a try. Black Forest Labs is a group composed of people who were behind [Stable Diffusion](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Stable+Diffusion), a popular open-source model. I knew it was worth checking out, and I wasn't disappointed. FLUX.1 is able to generate very realistic faces, and hands. It's also able to generate text much better than previous text-to-image image generation models. It is currently (August 2024) the number 1 model on [Imgen Arena](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Imgen+Arena). [Imgen Arena - DeveloPassion](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Imgen+Arena) And I can tell you that The Verge is spot on with [their article](https://www.theverge.com/2024/8/22/24225972/ai-photo-era-what-is-reality-google-pixel-9), we're not ready for this. The images that FLUX.1 is able to generate are hyper realistic, and with some effort, it's going to fool everyone. Fake images are now going to be the default in this world. And fake videos will also be the default real soon... It's both awesome for creativity, and scary for the future. As of August 2024, there are three main variants of FLUX.1: - flux-pro: the state-of-the-art model - flux-dev: a 12B parameter version of FLUX.1 - flux-schnell: a fast variant tailored for local development and personal use At first, I tried those base models to generate various images, such as this one: ![[image-55.png|FLUX.1 demo: a mossy forest rock with the word 'Obsidian' rendered in crisp text]] Caption: Prompt: obsidian rock in the forest with the word "Obsidian" engraved. Canon pro photo, 50mm, bokeh, flare, vignetting. Image generated using AI I wanted to see how well it was able to generate text, and was amazed, because it's MUCH more powerful than all the previous models I've tried: ![[image-56.png|FLUX.1 rendering handwritten text reading 'Personal Knowledge Management Wisdom']] Caption: Image generated using AI The ability to generate images with text is one that I was really after. It's an enabler to create powerful visuals for my articles. I also tried generating images with different styles: Image generated using AIImage generated using AI![[image-59.png|FLUX.1 cartoon mashup: Link from Zelda leaping off a Mario-style red mushroom]] Caption: Image generated using AI Each and every time, FLUX.1 generated amazing results. It rocks. Even using 'schnell', the fastest variant. I started using [Replicate.com](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Replicate.com), an online platform that enables running machine learning models in the cloud. The models run on their infrastructure, and they provide an API and SDKs to interact with the platform. Using Replicate.com, you can use various AI models, including those hosted on [HuggingFace](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/HuggingFace). It's possible to use the models either through their Web user interface, or using the API/SDKs: ![[image-60.png|Replicate web UI running a FLUX model to generate a grid of Moai-statue TED-talk images]] Caption: Using AI models through the user interface of Replicate.com Here's an example of how to use a model through (JS) code: import Replicate from "replicate"; const replicate = new Replicate({auth: process.env.REPLICATE_API_TOKEN}); const model = "stability-ai/stable-diffusion:27b93a2413e7f36cd83da926f3656280b2931564ff050bf9575f1fdf9bcd7478"; const input = {prompt: "a 19th century portrait of a raccoon gentleman wearing a suit"}; const output = await replicate.run(model, { input }); console.log(output); Quite straightforward if you know how to code! Then, I read a few articles, and learned more about [Low Rank Adapters (LoRAs)](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Low+Rank+Adapter+(LoRA)). I discovered how to train custom versions of FLUX.1 using my own photos, and I realized this was the next level. [Low Rank Adapter (LoRA) - DeveloPassion](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Low+Rank+Adapter+(LoRA)) After a bit of trial and error, my first model was created, and I could use it from Replicate.com (and anywhere else actually): ![[image-61.png|Replicate page for the author's custom-trained flux-lora-dsebastien model, ready to prompt]] Caption: A FLUX.1 LoRA I trained with my own face And now, I can easily generate images such as these: ![[image-54.png|FLUX-generated portrait of the author with a sad floral face-painting, matching the prompt]] Caption: Fake dSebastien. Image generated using AI This image was generated using the following prompt: `realistic photography extreme close up of a man called dsebastien with white painted floral profoundly sad contorted pouty face with a angry scowl of a frown defined with black makeup looking directly forward with an extremely sad contorted frown white painted faces` Fake dSebastien. Image generated using AIFake dSebastien. Image generated using AIFake dSebastien. Image generated using AIFake dSebastien. Image generated using AIFake dSebastien. Image generated using AI![[image-68.png|FLUX line-art sketch of the author writing in a notebook at a desk]] Caption: Fake dSebastien. Image generated using AI As you can see, while I know it's not me, it's actually pretty accurate. If you're interested in the "how", then you're in luck. I've published [a note explaining how you can do the same using your own pictures](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/How+to+train+a+FLUX.1+LoRA): [How to train a FLUX.1 LoRA - DeveloPassion](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/How+to+train+a+FLUX.1+LoRA) I'll soon post it on the blog as well. Later, I'll try to train custom models locally, to see how hard it is. I don't think it should be too complicated. I've also experimented with creating visuals for LinkedIn and Twitter. I was not disappointed: Image generated using AIImage generated using AIImage generated using AI![[twitter-banner-16-top.jpg|Man pointing at floating lightbulbs, illustrating creative ideas flowing from imagination]] Caption: Image generated using AI I feel like this can severely impact people who design for a living, to say the least. Hopefully, many of them, including the ones I know, tend to adopt those tools to boost their productivity... I then trained custom models with my kids, and we had some family-time fun: My son in an action movie. Image generated using AIMy son in an action movie. Image generated using AI![[am-disney-01.png|FLUX.1 generated Disney-style poster of Amandine as a magical fantasy heroine]] Caption: My daughter on a Disney movie poster. Image generated using AI I'm still amazed at how powerful this model is! Imagination is the only limit, or so it seems. ❤️ What matters to generate powerful images is writing clear, and precise descriptions. And since that's just text, LLMs such as ChatGPT and Claude.ai are perfect tools to improve the prompts. One resource I found really useful is [MidLibrary](https://midlibrary.io/), a collection of visual styles, artists, and visual features: [Midlibrary: Midjourney AI Styles Library + Midjourney Guides + Tools](https://midlibrary.io/) Right now, I'm also exploring the possibilities to combine multiple LoRAs, to be able to generate images leveraging different models in a single generated image. This should enable me to generate images combining different styles, different people, things, etc: [Combining multiple LoRAs - DeveloPassion](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Combining+multiple+LoRAs) I'll probably share more about this next week... Aside from that, I've also built an Obsidian plugin to integrate image generation capabilities using Replicate.com. Now, I can easily generate images directly from the Obsidian editor: Demo of the Obsidian replicate plugin I've built The plugin works great, and I will soon submit a PR to the Obsidian team, to turn it into an official community plugin 🚀. For now, the source code is available if you want to install it already: [GitHub - dsebastien/obsidian-replicate: Integrate Replicate.com with Obsidian](https://github.com/dsebastien/obsidian-replicate) ## Business The recent launch on [ProductHunt](https://www.producthunt.com/products/obsidian-starter-kit) continues to bring more attention to the [Obsidian Starter Kit](https://www.store.dsebastien.net/product/obsidian-starter-kit), but sales don't quite follow. I feel like the current price may be judged too high, which I find disappointing given how much effort I've already put into building it, and the overwhelmingly positive reviews/testimonials. I'm thinking about launching a survey, asking the opinion of all past customers, to try and find a better price point... [Obsidian Starter Kit and community](https://www.store.dsebastien.net/product/obsidian-starter-kit) I only sold 21 digital products in the past month, and the trend is far from reassuring: ![[image-69.png|Gumroad sales dashboard showing 21 sales and $850 revenue with declining spiky trend]] Caption: My sales on Gumroad.com in the past 30 days Clearly, my sales engine is rusty. Something is definitely wrong. The problem is that I don't know *what* and *why*. It may be because of the way I mention products in articles, because I don't reach new people who could be interested in my products, because of the prices, etc. I really have no clue, and it's tough for me to find out. If you haven't bought anything from me, then I'd really be curious to understand "why". Don't hesitate to reply to tell me, I'm all ears. This newsletter is also on a standstill. We're still at $112/month, with 19 paid subscribers out of 1724: ![[image-70.png|Ghost newsletter stats flatlining at $112 MRR with 19 paid out of 1,724 members]] Caption: DeveloPassion's newsletter stats I continue to hope that more of you will decide to become paid subscribers, and actually support the work that I do, making it more reliable as a source of income for me as a creator. Subscribe now ❤️: So, it's one more month where I just cannot pay myself, and struggle to keep the business alive. It's scary, but I'm not willing to give it all up just yet. I'm five years in, and I really have this feeling that I could be a few steps away from success. Who knows! ## New articles After seeing the same questions over and over on the Obsidian forums and on Reddit, I decided to write a small blog post to share my recommendations for newcomers: [Advice for people getting started with Knowledge Management and Writing](https://www.dsebastien.net/advice-for-people-getting-started-with-knowledge-management-and-writing//) I feel like many people keep stumbling on the same road blocks, and falling into the same traps. I also published a piece about why you should pick a tool, and stick with it (for long enough): [Pick a tool, and stick with it](https://www.dsebastien.net/pick-a-tool-and-stick-with-it//) Many people seem to procrastinate, hopping from one tool to the next, looking for the silver bullet. It's an anti-pattern, and I want to help them avoid that. ## New published notes This week, I took some time to describe my communications plan. You might want to check that out, if you're curious about how to stay in the know: [My communications plan - DeveloPassion](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/My+communications+plan) As I mentioned before, I've also started collecting notes about AI and AI image generation. I intend to expand that part of my knowledge base a lot more in the future: [AI Image Generation (MoC) - DeveloPassion](https://notes.dsebastien.net/30+Areas/34+MOCs/AI+Image+Generation+(MoC)) I also shared the ProductHunt launch checklist I've curated while preparing my first launch, along with my lessons learned: [Product Hunt Launch Checklist - DeveloPassion](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Product+Hunt+Launch+Checklist) Finally, I published some notes about memorization, and Spaced Repetition: - [https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Forgetting+curve](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Forgetting+curve) - [https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Spacing+effect](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Spacing+effect) - [https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Spaced+repetition](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Spaced+repetition) And there's probably a lot more I forgot to mention: [Recently added - DeveloPassion](https://notes.dsebastien.net/50+Resources/56+Obsidian+Publish/Recently+added) ## Note of the week ![[image-71.png|LinkedIn post advocating working on crazy ideas rather than chasing the next shiny tool]] I'm soon going to turn this one into an article. [Work on crazy ideas - DeveloPassion](https://notes.dsebastien.net/30+Areas/33+Permanent+notes/33.02+Content/Work+on+crazy+ideas) ## Quotes of the week - "Responsibility is the price of greatness" — Winston S. Churchill - "The goal isn't passive income. The goal is active income doing what you like" — Sahil Lavingia - "Don't just dream for success. Work hard for it" ## Books Summer is often a great period for me to dive into fiction books. This summer, I've read the following ones: ["Later" by Stephen King](https://notes.dsebastien.net/30+Areas/32+Literature+notes/32.03+Book+notes/Later+(book)): [Later (book) - DeveloPassion](https://notes.dsebastien.net/30+Areas/32+Literature+notes/32.03+Book+notes/Later+(book)) ["Mr Mercedes" by Stephen King](https://notes.dsebastien.net/30+Areas/32+Literature+notes/32.03+Book+notes/Mr+Mercedes+(book)): [Mr Mercedes (book) - DeveloPassion](https://notes.dsebastien.net/30+Areas/32+Literature+notes/32.03+Book+notes/Mr+Mercedes+(book)) ["Miracle Cure" by Harlan Coben](https://notes.dsebastien.net/30+Areas/32+Literature+notes/32.03+Book+notes/Rem%C3%A8de+mortel+(book)): [Remède mortel (book) - DeveloPassion](https://notes.dsebastien.net/30+Areas/32+Literature+notes/32.03+Book+notes/Rem%C3%A8de+mortel+(book)) And recently, I've dived into the "Silo" trilogy by Hugh Howey. I've finished the first volume, ["Wool"](https://notes.dsebastien.net/30+Areas/32+Literature+notes/32.03+Book+notes/Wool+(book)): [Wool (book) - DeveloPassion](https://notes.dsebastien.net/30+Areas/32+Literature+notes/32.03+Book+notes/Wool+(book)) And I'm now reading the second one, ["Shift"](https://notes.dsebastien.net/30+Areas/32+Literature+notes/32.03+Book+notes/Shift+(book)): [Shift (book) - DeveloPassion](https://notes.dsebastien.net/30+Areas/32+Literature+notes/32.03+Book+notes/Shift+(book)) I strongly recommend it. ## Thinking and learning A visualization of the evolution of my Knowledge base in Obsidian: [https://github.com/dsebastien/images/blob/main/personal-knowledge-graph-evolution.gif?raw=true](https://github.com/dsebastien/images/blob/main/personal-knowledge-graph-evolution.gif?raw=true) An interview of Andy Matuschak on the "Clearer Thinking" podcast: [Clearer Thinking with Spencer Greenberg](https://podcast.clearerthinking.org/episode/063/andy-matuschak-the-secrets-of-effective-learning/) Ryan Holiday about the writing process: Never ignore good life advice: [101 Additional Advices](https://kk.org/thetechnium/101-additional-advices/) An easy way to create aliases for Obsidian notes while adding links: [Obsidian Plugin: Link With Alias](https://www.workings.co/p/obsidian-plugin-link-with-alias) A free example vault shared by Steph Ango, the CEO of Obsidian: [Obsidian Vault Template](https://stephango.com/vault) My own: [Obsidian Starter Kit](https://obsidianstarterkit.com) Richard Feynman's problem-solving process: [ Feynman’s Garden The best description of my problem solving process is the Feynman algorithm, which is sometimes presented as a joke where the hidden subtext is “be smart”, but I disagree. The “algorithm” is a surprisingly lucid description of how thinking works in the context of hard problems where the answer can’t simply be looked up or trivially broken down, iterated upon in a bottom-up fashion, or approached with similar methods. Feynman’s thinking algorithm is described like this: ](https://www.marginalia.nu/log/a_108_feynman_revisited/) A workflow to capture insights while reading non-fiction books: [how books inspire me months later: my obsidian workflow](https://jphorism.substack.com/p/how-books-inspire-me-months-later) My own take on this topic: [How to take better notes while reading books](https://www.dsebastien.net/2022-02-17-how-to-capture-book-notes-and-create-smart-notes//) A cool Obsidian plugin to display the local graph in a banner on top of your notes: [GitHub - ras0q/obsidian-graph-banner: An Obsidian plugin to display a local graph view to the note header.](https://github.com/ras0q/obsidian-graph-banner) Zettelkasten success stories: > [Success histories? 4 years into Zettelkasten and not being fruitful](https://www.reddit.com/r/Zettelkasten//comments/1dko10r/success_histories_4_years_into_zettelkasten_and/) > by > [u/areallnamestakenreal](https://www.reddit.com/user/areallnamestakenreal/) in > [Zettelkasten](https://www.reddit.com/r/Zettelkasten//) And here's my own: ![[image-73.png|LinkedIn reply explaining how a knowledge base fuels writing output across hundreds of notes and articles]] By the way, consider the fact that Zettelkasten, and Knowledge Management in general, are not only for writers and content creators! Above all, those are THINKING tools. > [Is ZK worth for non article writers?](https://www.reddit.com/r/Zettelkasten//comments/1cmcqrh/is_zk_worth_for_non_article_writers/) > by > [u/magnomp](https://www.reddit.com/user/magnomp/) in > [Zettelkasten](https://www.reddit.com/r/Zettelkasten//) LINK: - [[How to Connect OpenClaw to Chrome via Tailscale (Article)]] - https://www.dsebastien.net/how-to-give-your-ai-agent-access-to-your-chrome-browser-and-why-you-should-be-scared// LINK: - [[How to Self-Host OpenClaw Securely on a VPS (Article)]] - https://www.dsebastien.net/how-to-self-host-openclaw-securely-on-a-vps-a-security-first-guide// LINK: - [[How to Prepare for the Future of Knowledge Work (Article)]] - https://www.dsebastien.net/preparing-for-the-future-of-knowledge-work// LINK: - [[AI Ghostwriter Guide]] - https://www.store.dsebastien.net//product/ai-ghostwriter-guide