A can't upload image to lfs in netlify

dariuszpaluch · September 4, 2020, 6:50pm

I have a problem with netlify large media. I can’t upload the image to netlify when I run git lfs push origin --all I got a communication:

Uploading LFS objects:   0% (0/1), 0 B | 0 B/s, done
batch response: Repository or object not found: https://fda32c29-ea08-415e-8aa1-08ec7cea204e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
error: failed to push some refs to https://github.com/....

I don’t know what is wrong. I made all from documentations

and checked on two computers. Nothing change. Please help

luke · September 7, 2020, 9:59am

Hi, @dariuszpaluch, was the Git credential helper line added to .bash_profile?

Also, what is the output of this command?

netlify lm:info

dev-boldium-ebce · October 5, 2020, 11:41pm

@luke, not sure about darius, but I’m getting the same error (with a different repo url) and my output is pretty good

netlify lm:info
Checking Git version [Git-128)]
Checking Git LFS version [2.11.0]
Checking Git LFS filters
Checking Netlify’s Git Credentials version

luke · October 6, 2020, 3:34am

Hi, @dev-boldium-ebce. I don’t see a Git Credential helper version in that output:

$ netlify lm:info
  ✔ Checking Git version [2.26.2]
  ✔ Checking Git LFS version [2.10.0]
  ✔ Checking Git LFS filters
  ✔ Checking Netlify's Git Credentials version [0.1.9]

Was the Git credential helper line added to .bash_profile (or the equivalent file for your system)?

dev-boldium-ebce · October 6, 2020, 4:02pm

@luke, I’ll check, what should that look like? I didn’t see it in the docs.

luke · October 7, 2020, 1:42am

The requirement is printed to the console when the netlify lm:install command is run with the correct line for the user running the command.

For example, it might look like this:

$ netlify lm:install
  ✔ Checking Git version [2.25.1]
  ✔ Checking Git LFS version [2.9.2]
  ✔ Checking Git LFS filters
  ✔ Installing Netlify's Git Credential Helper for Linux
  ✔ Configuring Git to use Netlify's Git Credential Helper

   ┌───────────────────────────────────────────────────────────────────────┐
   │                                                                       │
   │   Run this command to use Netlify Large Media in your current shell   │
   │                                                                       │
   │          source /home/username/.netlify/helper/path.bash.inc          │
   │                                                                       │
   └───────────────────────────────────────────────────────────────────────┘

That line above is for the bash shell being used on a Linux system. If you are using zsh on MacOs, the output would be different; it would be whatever was correct for your system.

There isn’t a docs line because different systems and configurations require different solutions. We would need pages of documentation to explain all the correct answers and variations. Instead, the CLI tool determines the correct line and prints it.

If you don’t have the required line in the shell config file, we can help you get that configured.

First, it would help to know what shell you are using and to see the output of the command tree ~/.netlify/helper on your local system. For example:

$ tree ~/.netlify/helper
/home/username/.netlify/helper
├── bin
│   └── git-credential-netlify
├── git-config
└── path.bash.inc

1 directory, 3 files

With this information we can confirm what line to add and what file to add it to. If there are questions about any of this, please let us know.

dev-boldium-ebce · October 7, 2020, 1:54am

Thanks @luke that makes alot of sense,
After running:
tree ~/.netlify/helper

The response I get is
zsh: command not found: tree

Would it be handy if I just did a ls, or cat some files for you or something?

I tried this in both the mac terminal and the vs code build in terminal

luke · October 7, 2020, 7:05am

About this:

It would but I didn’t know which file to tell you to cat. The tree command wasn’t installed. This be done using Homebrew with:

brew install tree

You mentioned Mac and I see zsh is the shell. You probably need to add a helper to the configuration file for zsh. This is likely already installed and the tree command would tell me the correct path to add to the .zshrc or .profile file (whichever your system is using).

This is what was added on a Linux system for testing:

# The next line updates PATH for Netlify's Git Credential Helper.
if [ -f '/home/username/.netlify/helper/path.zsh.inc' ]; then source '/home/username/.netlify/helper/path.zsh.inc'; fi

For MacOS, this would likely be the following instead:

# The next line updates PATH for Netlify's Git Credential Helper.
if [ -f '/Users/username/.netlify/helper/path.zsh.inc' ]; then source '/Users/username/.netlify/helper/path.zsh.inc'; fi

Note, that change won’t affect any existing terminal windows (aka shell sessions). To make the change take effect in an existing window, use the following:

source /Users/username/.netlify/helper/path.zsh.inc

If adding that line doesn’t help, please let us know.

dev-boldium-ebce · October 7, 2020, 2:53pm

Hey there @luke,

Here’s the response I got from tree
/Users/ericmikkelsen/.netlify/helper
├── bin
│ └── git-credential-netlify
├── git-config
└── path.zsh.inc

Also I added a .bash_profile and this line (but with my user name)
if [ -f '/home/username/.netlify/helper/path.zsh.inc' ]; then source '/home/username/.netlify/helper/path.zsh.inc'; fi

I’m still getting this after closing the terminal and re-opening it:

batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch

Check that it exists and that you have proper access to it

Thanks for all the help so far

luke · October 8, 2020, 2:22am

Hi, @dev-boldium-ebce. Did you also change /home to /Users like so:

 if [ -f '/Users/ericmikkelsen/.netlify/helper/path.zsh.inc' ]; then source '/Users/ericmikkelsen/.netlify/helper/path.zsh.inc'; fi

Also, you are using zsh and not bash so this line would added to .zshrc because zsh won’t read .bash_profile.

Would you please try both those changes as well?

dev-boldium-ebce · October 8, 2020, 7:18pm

Hey @luke, I just updated it, then tried pushing it hung for a long time then rejected in the same way with a bunch of:

Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch

errors, but the most interesting thing is when I run tree again, it has all my tracked files listed out in there.

luke · October 9, 2020, 9:37am

Hi, @dev-boldium-ebce. It sounds much like the Git credential helper still isn’t working.

What does netlify lm:info show now? For example:

$ netlify lm:info
  ✔ Checking Git version [2.28.0]
  ✔ Checking Git LFS version [2.12.0]
  ✔ Checking Git LFS filters
  ✔ Checking Netlify's Git Credentials version [0.1.9]

dev-boldium-ebce · October 9, 2020, 7:37pm

Hey @luke Here’s what I get for my output on the netlify lm:info

  ✔ Checking Git version [Git-128)]
  ✔ Checking Git LFS version [2.12.0]
  ✔ Checking Git LFS filters
  ✔ Checking Netlify's Git Credentials version [0.1.9]

dev-boldium-ebce · October 10, 2020, 12:49am

Hey there, Just wanted to drop a couple pieces of additional context

we’re not seeing anything under our Netlify Large media tab on our account
We’ve validated that netlify credential helper is in my path and is accessible
We had configured git lfs, but hadn’t pushed any lfs files to the repo yet, and we followed these steps to make sure they were tracked by netlify large media
and our .lfsconfig file is present and looks correct.

luke · October 12, 2020, 4:29am

Hi, @dev-boldium-ebce. This sounds a lot like the issue here in this earlier topic:

Just like in the comment above, it looks like you are also using the default Git client with MacOS (from the version “Git-128”).

To summarize, I think there is some combination of three things happening:

an issue with multiple Git clients being installed and different clients being used in different contexts
an issue with the presence of the Git credential helper
an issue with the ordering of the Git credential helpers

I think you will be much more successful once the version reported by netlify lm:info is some 2.x.x version and not “Git-128”.

Resolving that can be done with:

installing the Homebrew version of Git
setting the shell PATH environment variable so that the correct Git client is consistently used (the Homebrew version)

Please let us know if there are questions about how to make those changes.

Once the netlify lm:info reports a 2.x.x version, you might find the git push issue to be resolved.

If getting the Git version updated and consistent does not resolve the git push issues, then we can move on to troubleshooting issues two and three above.

If you are that that point, would you please send us the output of these two commands below?

git config -l
env | grep "PATH"

As always, if there are questions about any of this, please let us know.

dev-boldium-ebce · October 13, 2020, 4:13pm

Hey @luke, it looks like git update didn’t fix it, here’s my netlify lm:info output

  ✔ Checking Git version [2.28.0]
  ✔ Checking Git LFS version [2.12.0]
  ✔ Checking Git LFS filters
  ✔ Checking Netlify's Git Credentials version [0.1.9]

After running the git config -l output is:

credential.helper=osxkeychain
user.email=eric.mikkelsen@boldium.com
include.path=/Users/ericmikkelsen/.netlify/helper/git-config
credential.helper=
credential.helper=netlify
filter.lfs.clean=git-lfs clean -- %f
filter.lfs.smudge=git-lfs smudge -- %f
:...skipping...
credential.helper=osxkeychain
user.email=eric.mikkelsen@boldium.com
include.path=/Users/ericmikkelsen/.netlify/helper/git-config
credential.helper=
credential.helper=netlify
filter.lfs.clean=git-lfs clean -- %f
filter.lfs.smudge=git-lfs smudge -- %f
filter.lfs.process=git-lfs filter-process
filter.lfs.required=true
include.path=/Users/ericmikkelsen/.netlify/helper/git-config
credential.helper=
credential.helper=netlify
core.repositoryformatversion=0
core.filemode=true
core.bare=false
core.logallrefupdates=true
core.ignorecase=true
core.precomposeunicode=true
remote.origin.url=git@github.com:devboldium/ebce.org-11ty.git
remote.origin.fetch=+refs/heads/*:refs/remotes/origin/*
branch.trunk.remote=origin
branch.trunk.merge=refs/heads/trunk
lfs.https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media.locksverify=false
credential.helper=netlify

And the env | grep "PATH" output is:

PATH=/Users/ericmikkelsen/.netlify/helper/bin:/Users/ericmikkelsen/.netlify/helper/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Library/Apple/usr/bin:/Users/ericmikkelsen/.netlify/helper/bin

luke · October 14, 2020, 1:45am

I’m seeing the issue in the git config -l output.

We need the output to look like this:

credential.helper=
credential.helper=netlify
credential.helper=osxkeychain

It can also look like this (if these are the only two lines for “credential.helper” in the file):

credential.helper=netlify
credential.helper=osxkeychain

The “empty value” line below is important (or it can be skpped):

credential.helper=

Let’s take a look at the contents of ~/.netlify/helper/git-config for an explanation:

$ cat ~/.netlify/helper/git-config

# The first line resets the list of helpers so we can check Netlify's first.
[credential]
  helper = ""

[credential]
  helper = netlify
  helper = osxkeychain

Setting the credential helper to empty string is resetting the list. Then the order after that must be “netlify” then “osxkeychain”.

Let’s take a look at your system’s git config -l output filtered for just the “helper” lines (but otherwise left in order):

$ grep helper git-config-output.txt
credential.helper=osxkeychain
include.path=/Users/ericmikkelsen/.netlify/helper/git-config
credential.helper=
credential.helper=netlify
credential.helper=osxkeychain
include.path=/Users/ericmikkelsen/.netlify/helper/git-config
credential.helper=
credential.helper=netlify
include.path=/Users/ericmikkelsen/.netlify/helper/git-config
credential.helper=
credential.helper=netlify
credential.helper=netlify

So, to summarize, your ordering is:

credential.helper=
credential.helper=netlify

This is because only the lines after the most recent empty string line matter. So, your credential helpers are not in order.

Would you please confirm your ~/.netlify/helper/git-config file contains just this below?

# The first line resets the list of helpers so we can check Netlify's first.
[credential]
  helper = ""

[credential]
  helper = netlify
  helper = osxkeychain

If so, please close your terminal window, open a new window, and then run git config -l again. If this ordering isn’t fixed or if the git push still doesn’t work, please let us know.

Also, if it is still not working, would you please send us the exact command being run and output of that command?

dev-boldium-ebce · October 14, 2020, 7:13am

Hey @luke thanks for the walk deep dive I super appreciate it.

It looks like I’m missing osxkeychain in my helper file

# The first line resets the list of helpers so we can check Netlify's first.
[credential]
  helper = ""

[credential]
  helper = netlify

Here’s the total output when I try to git push origin trunk

batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
Uploading LFS objects:   0% (0/101), 0 B | 0 B/s, done.
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
error: failed to push some refs to 'github.com:devboldium/ebce.org-11ty.git'

As for updating my gitconfig, should I do that by hand and same question for adding the osxkeychain to my netlify config.

luke · October 14, 2020, 8:21am

Hi, @dev-boldium-ebce. Yes, if you are using MacOS, add this line to that file:

  helper = osxkeychain

Then close and reopen new terminal window. Then the git config -l output should show the updated configuration. (If not, please reply anytime.)

dev-boldium-ebce · October 14, 2020, 5:42pm

Hey @luke,

So I added helper osxkeychain to my ~/.netlify/helper/git-config
So it now looks like this

# The first line resets the list of helpers so we can check Netlify's first.
[credential]
  helper = ""

[credential]
  helper = netlify
  helper = osxkeychain

Then when I run git config -l
I get this

include.path=/Users/ericmikkelsen/.netlify/helper/git-config
credential.helper=
credential.helper=netlify
credential.helper=osxkeychain
filter.lfs.clean=git-lfs clean -- %f
filter.lfs.smudge=git-lfs smudge -- %f
filter.lfs.process=git-lfs filter-process
filter.lfs.required=true
include.path=/Users/ericmikkelsen/.netlify/helper/git-config
credential.helper=
credential.helper=netlify
credential.helper=osxkeychain

Then when I tried to push my branch using git push origin trunk
I got this again

batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch                   
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
Uploading LFS objects:   0% (0/100), 0 B | 0 B/s, done.
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
batch response: Repository or object not found: https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media/objects/batch
Check that it exists and that you have proper access to it
error: failed to push some refs to 'github.com:devboldium/ebce.org-11ty.git'

then when I run git config -l again I get this output

credential.helper=osxkeychain
user.email=eric.mikkelsen@boldium.com
include.path=/Users/ericmikkelsen/.netlify/helper/git-config
credential.helper=
credential.helper=netlify
credential.helper=osxkeychain
filter.lfs.clean=git-lfs clean -- %f
filter.lfs.smudge=git-lfs smudge -- %f
filter.lfs.process=git-lfs filter-process
filter.lfs.required=true
include.path=/Users/ericmikkelsen/.netlify/helper/git-config
credential.helper=
credential.helper=netlify
credential.helper=osxkeychain
core.repositoryformatversion=0
core.filemode=true
core.bare=false
core.logallrefupdates=true
core.ignorecase=true
core.precomposeunicode=true
remote.origin.url=git@github.com:devboldium/ebce.org-11ty.git
remote.origin.fetch=+refs/heads/*:refs/remotes/origin/*
branch.trunk.remote=origin
branch.trunk.merge=refs/heads/trunk
lfs.https://8af78b07-6f98-4b04-9a19-2daa8040e79e.netlify.app/.netlify/large-media.locksverify=false
credential.helper=netlify

and just for posterity here’s the output of my current netlify lm:info

  ✔ Checking Git version [2.28.0]
  ✔ Checking Git LFS version [2.12.0]
  ✔ Checking Git LFS filters
  ✔ Checking Netlify's Git Credentials version [0.1.9]

Topic		Replies	Views
Fail to upload to LFS Support netlify-large-media-nlm , git-lfs	2	754	August 11, 2021
Netlify LFS Error: error: failed to push some refs to repo Support netlify-large-media-nlm	1	2206	March 16, 2022
Netlify Large Media error: Repository or object not found Support deployment , netlify-large-media-nlm	12	346	May 28, 2024
Git push issues with Git LFS and/or Large Media Support git , netlify-large-media-nlm , git-lfs	6	1830	October 26, 2020
Error saving upload data Support netlify-large-media-nlm	3	667	June 16, 2020

A can't upload image to lfs in netlify

Related topics